Sep 16 21:44:30 devstack cinder-volume[74983]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 21:44:30 devstack cinder-volume[74983]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 21:44:30 devstack cinder-volume[74983]: we strongly recommend against using it for new projects.
Sep 16 21:44:30 devstack cinder-volume[74983]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 21:44:30 devstack cinder-volume[74983]: framework.  For more detail see
Sep 16 21:44:30 devstack cinder-volume[74983]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 21:44:30 devstack cinder-volume[74983]:   import eventlet  # noqa
Sep 16 21:44:33 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:44:33 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:44:33 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:44:34 devstack cinder-volume[74983]: INFO dbcounter [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Registered counter for database cinder
Sep 16 21:44:34 devstack cinder-volume[74983]: DEBUG oslo_db.sqlalchemy.engines [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:44:34 devstack cinder-volume[74983]: DEBUG dbcounter [-] [74983] Writer thread running {{(pid=74983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:44:34 devstack cinder-volume[74983]: INFO cinder.rpc [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 21:44:34 devstack cinder-volume[74983]: INFO cinder.rpc [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_db.sqlalchemy.engines [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO cinder.volume.manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Determined volume DB was empty at startup.
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG cinder.volume.manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74983) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO cinder.volume.manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 21:44:35 devstack cinder-volume[74983]: WARNING stevedore.named [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 21:44:35 devstack cinder-volume[74983]: WARNING castellan.key_manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:44:35 devstack cinder-volume[74983]: WARNING cinder.keymgr.conf_key_mgr [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG cinder.volume.drivers.lvm [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74983) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_concurrency.processutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74983) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_concurrency.processutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.402s {{(pid=74983) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_db.sqlalchemy.engines [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO cinder.rpc [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO cinder.rpc [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 16 21:44:35 devstack cinder-volume[74983]: WARNING stevedore.named [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 21:44:35 devstack cinder-volume[74983]: WARNING castellan.key_manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO cinder.volume.manager [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_db.sqlalchemy.engines [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74983) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:44:35 devstack cinder-volume[74983]: INFO oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Starting 1 workers
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Started child 75137 {{(pid=74983) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Full set of CONF: {{(pid=74983) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] ******************************************************************************** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Configuration options gathered from: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] ================================================================================ {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] allow_availability_zone_fallback = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] allow_compression_on_image_upload = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] allowed_direct_url_schemes     = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] api_rate_limit                 = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] auth_strategy                  = keystone {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] az_cache_duration              = 3600 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_availability_zone      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_host                   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_name                   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_stats_polling_interval = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backup_api_class               = cinder.backup.api.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backup_name_template           = backup-%s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backup_use_same_host           = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backup_use_temp_snapshot       = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[75137]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] chap_password                  = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] chap_username                  =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_internal_tenant_project_id = c5560cc540f4467dacf14a927d698937 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_internal_tenant_user_id = 111e1bed28cf4ad9bbaa8dd45035fde2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cloned_volume_same_az          = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cluster                        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] compression_format             = gzip {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] config_dir                     = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] config_source                  = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] control_exchange               = openstack {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] debug                          = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] default_availability_zone      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] default_group_type             = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] default_volume_type            = lvmdriver-1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] disk_geometry                  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_client_cert             = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_client_cert_key         = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_data_namespace          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_ssl_cert_path           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_ssl_cert_verify         = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] driver_use_ssl                 = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] enable_force_upload            = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] enable_new_services            = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] enable_unsupported_driver      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] enforce_multipath_for_image_xfer = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] filter_function                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_api_insecure            = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_api_servers             = ['http://192.168.122.194/image'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_api_ssl_compression     = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_ca_certificates_file    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_certfile                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_keyfile                 = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_num_retries             = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance_request_timeout         = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] goodness_function              = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] graceful_shutdown_timeout      = 5 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] group_api_class                = cinder.group.api.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] host                           = devstack {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_compress_on_upload       = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_conversion_address_space_limit = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_conversion_cpu_limit     = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_conversion_disable       = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_introspection_address_space_limit = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_introspection_cpu_limit  = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_upload_use_cinder_backend = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_upload_use_internal_tenant = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_volume_cache_enabled     = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_volume_cache_max_count   = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] image_volume_cache_max_size_gb = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] init_host_max_objects_retrieval = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iscsi_target_flags             =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iscsi_write_cache              = on {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iser_helper                    = tgtadm {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iser_ip_address                = 192.168.122.194 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iser_port                      = 3260 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_color                      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_config_append              = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_dir                        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_file                       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_options                    = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_rotate_interval            = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_rotate_interval_type       = days {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] log_rotation_type              = none {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] max_age                        = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] max_logfile_count              = 30 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] max_logfile_size_mb            = 200 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] max_over_subscription_ratio    = 20.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] message_reap_interval          = 86400 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] message_ttl                    = 2592000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] migration_create_volume_timeout_secs = 300 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] monkey_patch                   = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] monkey_patch_modules           = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] my_ip                          = 192.168.122.194 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] no_snapshot_gb_quota           = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] num_iser_scan_tries            = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] num_shell_tries                = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] num_volume_device_scan_tries   = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] nvmeof_conn_info_version       = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] nvmet_ns_id                    = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] nvmet_port_id                  = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_max_limit                = 1000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_ext_list          = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_listen_port       = 8776 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_use_ssl           = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] osapi_volume_workers           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] per_volume_size_limit          = -1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] periodic_fuzzy_delay           = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] periodic_interval              = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] public_endpoint                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] publish_errors                 = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_backup_gigabytes         = 1000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_backups                  = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_gigabytes                = 1000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_groups                   = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_snapshots                = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] quota_volumes                  = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] rate_limit_burst               = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] rate_limit_except_level        = CRITICAL {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] rate_limit_interval            = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] reinit_driver_count            = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] replication_device             = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] report_discard_supported       = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] report_interval                = 120 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] reservation_clean_interval     = 86400 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] reservation_expire             = 86400 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] reserved_image_namespaces      = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] reserved_percentage            = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] rpc_response_timeout           = 120 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] run_external_periodic_tasks    = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] scst_target_driver             = iscsi {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] scst_target_iqn_name           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_down_time              = 720 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] shell_completion               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] snapshot_name_template         = snapshot-%s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] snapshot_same_host             = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] split_loggers                  = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] state_path                     = /opt/stack/data/cinder {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] storage_availability_zone      = nova {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] storage_protocol               = iSCSI {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] syslog_log_facility            = LOG_USER {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_helper                  = lioadm {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_ip_address              = 192.168.122.194 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_port                    = 3260 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_protocol                = iscsi {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] target_secondary_ip_addresses  = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] trace_flags                    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] transport_url                  = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] until_refresh                  = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_chap_auth                  = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_default_quota_class        = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_journal                    = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_json                       = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_multipath_for_image_xfer   = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_stderr                     = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] use_syslog                     = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] verify_glance_signatures       = enabled {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_api_class               = cinder.volume.api.API {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_backend_name            = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_clear                   = zero {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_clear_ionice            = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_clear_size              = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_copy_bps_limit          = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_dd_blocksize            = 1M {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_name_template           = volume-%s {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_service_inithost_offload = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volume_usage_audit_period      = month {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] zoning_mode                    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_concurrency.disable_process_locking = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.auth_section = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.auth_type   = password {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.auth_version = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.cache       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.certfile    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.include_service_catalog = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.insecure    = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.interface   = public {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.keyfile     = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_password = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcache_username = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.region_name = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.service_type = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.backend                  = dogpile.cache.null {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.backend_argument         = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.backend_expiration_time  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.config_prefix            = cache.oslo {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.debug_cache_backend      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.enable_retry_client      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.enable_socket_keepalive  = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.enabled                  = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.expiration_time          = 600 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.hashclient_retry_attempts = 2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_dead_retry      = 300 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_sasl_enabled    = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.password                 = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.proxies                  = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.redis_db                 = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.redis_server             = localhost:6379 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.retry_attempts           = 2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.retry_delay              = 0.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.socket_keepalive_count   = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.socket_keepalive_idle    = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.socket_keepalive_interval = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.socket_timeout           = 1.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.tls_allowed_ciphers      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.tls_cafile               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.tls_certfile             = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.tls_enabled              = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.tls_keyfile              = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cache.username                 = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] coordination.backend_url       = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.asyncio_connection    = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.asyncio_slave_connection = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.backend               = sqlalchemy {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.connection            = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.connection_debug      = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.connection_parameters =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.connection_recycle_time = 3600 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.connection_trace      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.db_inc_retry_interval = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.db_max_retries        = 20 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.db_max_retry_interval = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.db_retry_interval     = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.max_overflow          = 50 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.max_pool_size         = 5 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.max_retries           = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.mysql_wsrep_sync_wait = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.pool_timeout          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.retry_interval        = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.slave_connection      = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.sqlite_synchronous    = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.synchronous_reader    = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] database.use_db_reconnect      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_tracing.insecure = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.connection_string     = messaging:// {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.enabled               = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.es_doc_type           = notification {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.es_scroll_size        = 10000 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.es_scroll_time        = 2m {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.filter_error_trace    = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.hmac_keys             = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.sentinel_service_name = mymaster {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.socket_timeout        = 0.1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.trace_requests        = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler.trace_sqlalchemy      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler_jaeger.process_tags   = {} {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler_jaeger.service_name_prefix = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] profiler_otlp.service_name_prefix = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.enforce_new_defaults = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.policy_default_rule = default {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.group          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.helper_command = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] privsep_osbrick.user           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.group         = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.helper_command = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] cinder_sys_admin.user          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.auth_section      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.auth_type         = password {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.cafile            = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.certfile          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.collect_timing    = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.insecure          = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.keyfile           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.send_service_user_token = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.split_loggers     = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.timeout           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.tls_ciphers       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] service_user.tls_min_version   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.auth_section            = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.auth_type               = password {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.certfile                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.collect_timing          = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.insecure                = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.keyfile                 = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.region_name             = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.split_loggers           = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.timeout                 = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.tls_ciphers             = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] glance.tls_min_version         = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.backend_availability_zone = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.chap_password = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.chap_username =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.disk_geometry = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_client_cert = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_client_cert_key = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_data_namespace = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.driver_use_ssl = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.extra_capabilities = {} {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.filter_function = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.goodness_function = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iscsi_target_flags =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iscsi_write_cache = on {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iser_port     = 3260 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.lvm_share_target = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.lvm_type      = auto {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.num_shell_tries = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.replication_device = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.report_discard_supported = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.reserved_percentage = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_helper = tgtadm {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_port   = 3260 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_protocol = iscsi {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.trace_flags   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.unique_fqdn_network = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.use_chap_auth = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_backend_name = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_clear  = zero {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_clear_ionice = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_clear_size = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_reports.file_event_handler = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_reports.log_dir           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.backend_host       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.chap_password      = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.chap_username      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.disk_geometry      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_client_cert = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.extra_capabilities = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.filter_function    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.goodness_function  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iser_helper        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iser_port          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.lvm_type           = auto {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.replication_device = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.report_discard_supported = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.reserved_percentage = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.scst_target_driver = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.storage_protocol   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_ip_address  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_port        = 3260 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.trace_flags        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_clear       = zero {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] lvmdriver-1.volumes_dir        = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_notifications.driver = [] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_notifications.retry = -1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] key_manager.fixed_key          = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.barbican_api_version  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.barbican_endpoint     = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.barbican_endpoint_type = public {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.barbican_region_name  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.cafile                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.certfile              = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.collect_timing        = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.insecure              = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.keyfile               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.number_of_retries     = 60 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.retry_delay           = 1 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.send_service_user_token = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.split_loggers         = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.timeout               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.tls_ciphers           = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.tls_min_version       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.verify_ssl            = True {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican.verify_ssl_path       = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.auth_section = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.auth_type = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.cafile   = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.certfile = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.collect_timing = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.insecure = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.keyfile  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.split_loggers = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.timeout  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.tls_ciphers = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] barbican_service_user.tls_min_version = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.approle_role_id          = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.approle_secret_id        = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.auth_method              = approle {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.auth_path                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.kv_mountpoint            = secret {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.kv_path                  = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.kv_version               = 2 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.namespace                = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.root_token_id            = **** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.ssl_ca_crt_file          = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.timeout                  = 60.0 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.token_file               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.token_role               = None {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.use_ssl                  = False {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:44:35 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] ******************************************************************************** {{(pid=74983) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 21:44:35 devstack sudo[75144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 16 21:44:35 devstack sudo[75144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:36 devstack sudo[75144]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:36 devstack sudo[75147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:36 devstack sudo[75147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:36 devstack sudo[75147]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.245s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:44:36 devstack cinder-volume[75137]: INFO cinder.brick.local_dev.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:36 devstack sudo[75259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:36 devstack sudo[75259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:36 devstack sudo[75259]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG cinder.brick.local_dev.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75137) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 16 21:44:36 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:36 devstack sudo[75347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:36 devstack sudo[75347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:37 devstack sudo[75347]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:37 devstack sudo[75538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:37 devstack sudo[75538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:37 devstack sudo[75538]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:37 devstack sudo[75629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 16 21:44:37 devstack sudo[75629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:37 devstack sudo[75629]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.324s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:37 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:37 devstack sudo[75748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:37 devstack sudo[75748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:38 devstack sudo[75748]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:38 devstack sudo[75751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:38 devstack sudo[75751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:38 devstack sudo[75751]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:38 devstack sudo[75834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:38 devstack sudo[75834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:38 devstack sudo[75834]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:38 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:38 devstack sudo[75837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:38 devstack sudo[75837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:39 devstack sudo[75837]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack sudo[75903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:39 devstack sudo[75903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:39 devstack sudo[75903]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: INFO cinder.volume.drivers.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack sudo[75937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:39 devstack sudo[75937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:39 devstack sudo[75937]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack sudo[75940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:39 devstack sudo[75940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:39 devstack sudo[75940]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:39 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:39 devstack sudo[75943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:39 devstack sudo[75943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:40 devstack sudo[75943]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:40 devstack sudo[75946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:40 devstack sudo[75946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:40 devstack sudo[75946]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:40 devstack sudo[75950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:40 devstack sudo[75950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:40 devstack sudo[75950]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:40 devstack cinder-volume[75137]: INFO cinder.volume.driver [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG cinder.volume.driver [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75137) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_db.sqlalchemy.engines [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writer thread running {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG cinder.db.api [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Building query based on filter {{(pid=75137) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG cinder.image.image_utils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75137) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 21:44:40 devstack cinder-volume[75137]: INFO cinder.keymgr.migration [None req-9f42e37c-95c9-4d66-a0dc-9131873b5a93 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:44:40 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:40 devstack sudo[75953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:40 devstack sudo[75953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:41 devstack sudo[75953]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:41 devstack sudo[75956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:41 devstack sudo[75956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:41 devstack sudo[75956]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:41 devstack sudo[75961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:41 devstack sudo[75961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:41 devstack sudo[75961]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:41 devstack sudo[75965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:41 devstack sudo[75965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:41 devstack sudo[75965]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG cinder.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Notifying Schedulers of capabilities ... {{(pid=75137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:44:41 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Driver initialization completed successfully.
Sep 16 21:44:41 devstack cinder-volume[75137]: INFO cinder.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Initiating service 2 cleanup
Sep 16 21:44:41 devstack cinder-volume[75137]: INFO cinder.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Service 2 cleanup completed.
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG cinder.service [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Creating RPC server for service cinder-volume {{(pid=75137) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 21:44:41 devstack cinder-volume[75137]: DEBUG cinder.service [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75137) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 21:44:42 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:42 devstack sudo[75968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:44:42 devstack sudo[75968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:42 devstack sudo[75968]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:42 devstack sudo[75971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:42 devstack sudo[75971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:42 devstack sudo[75971]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:42 devstack sudo[75979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:44:42 devstack sudo[75979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:42 devstack sudo[75979]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:42 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:44:42 devstack sudo[75982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:44:42 devstack sudo[75982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:44:43 devstack sudo[75982]: pam_unix(sudo:session): session closed for user root
Sep 16 21:44:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:44:43 devstack cinder-volume[75137]: INFO cinder.volume.manager [None req-26fa7bff-650e-46e1-849e-5fc7a81e1311 None None] Driver post RPC initialization completed successfully.
Sep 16 21:44:43 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager._thread_info {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:44:43 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread count: 6 {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:44:43 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread info: [<_MainThread(MainThread, started 131078248616064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131078136627712)>, <Thread(Thread-3 (stat_writer), started daemon 131078133236224)>, <Thread(Rabbit-heartbeat, started daemon 131078133539840)>, <Thread(Thread-5 (_runner), started daemon 131078133077696)>, <Thread(Thread-7 (_runner), started daemon 131078131128384)>] {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:44:45 devstack cinder-volume[74983]: DEBUG dbcounter [-] [74983] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74983) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:44:51 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:SELECT=3 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:44:53 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:45:43 devstack sudo[78009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:45:43 devstack sudo[78009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:45:43 devstack sudo[78009]: pam_unix(sudo:session): session closed for user root
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:45:43 devstack sudo[78012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:45:43 devstack sudo[78012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:45:43 devstack sudo[78012]: pam_unix(sudo:session): session closed for user root
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:45:43 devstack sudo[78015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:45:43 devstack sudo[78015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:45:43 devstack sudo[78015]: pam_unix(sudo:session): session closed for user root
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:45:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:45:43 devstack sudo[78018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:45:43 devstack sudo[78018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:45:44 devstack sudo[78018]: pam_unix(sudo:session): session closed for user root
Sep 16 21:45:44 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:45:44 devstack cinder-volume[75137]: DEBUG cinder.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Notifying Schedulers of capabilities ... {{(pid=75137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:45:44 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager._thread_info {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:45:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread count: 6 {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:45:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread info: [<_MainThread(MainThread, started 131078248616064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131078136627712)>, <Thread(Thread-3 (stat_writer), started daemon 131078133236224)>, <Thread(Rabbit-heartbeat, started daemon 131078133539840)>, <Thread(Thread-5 (_runner), started daemon 131078133077696)>, <Thread(Thread-7 (_runner), started daemon 131078131128384)>] {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:46:43 devstack sudo[81369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:46:43 devstack sudo[81369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:46:43 devstack sudo[81369]: pam_unix(sudo:session): session closed for user root
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:46:43 devstack sudo[81373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:46:43 devstack sudo[81373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:46:43 devstack sudo[81373]: pam_unix(sudo:session): session closed for user root
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:46:43 devstack sudo[81376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:46:43 devstack sudo[81376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:46:43 devstack sudo[81376]: pam_unix(sudo:session): session closed for user root
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:46:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:46:43 devstack sudo[81395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:46:43 devstack sudo[81395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:46:44 devstack sudo[81395]: pam_unix(sudo:session): session closed for user root
Sep 16 21:46:44 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:46:44 devstack cinder-volume[75137]: DEBUG cinder.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Notifying Schedulers of capabilities ... {{(pid=75137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:46:44 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager._thread_info {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:46:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread count: 6 {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:46:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread info: [<_MainThread(MainThread, started 131078248616064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131078136627712)>, <Thread(Thread-3 (stat_writer), started daemon 131078133236224)>, <Thread(Rabbit-heartbeat, started daemon 131078133539840)>, <Thread(Thread-5 (_runner), started daemon 131078133077696)>, <Thread(Thread-7 (_runner), started daemon 131078131128384)>] {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:46:53 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:SELECT=1 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:46:53 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:UPDATE=1 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:47:43 devstack sudo[83414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:47:43 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:47:43 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:47:43 devstack sudo[83417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:47:43 devstack sudo[83417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:47:43 devstack sudo[83417]: pam_unix(sudo:session): session closed for user root
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:47:43 devstack sudo[83420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:47:43 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:47:43 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:47:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:47:43 devstack sudo[83436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:47:43 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:47:44 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root
Sep 16 21:47:44 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:47:44 devstack cinder-volume[75137]: DEBUG cinder.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Notifying Schedulers of capabilities ... {{(pid=75137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:47:44 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager._thread_info {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:47:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread count: 6 {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:47:44 devstack cinder-volume[75137]: DEBUG cinder.volume.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] thread info: [<_MainThread(MainThread, started 131078248616064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131078136627712)>, <Thread(Thread-3 (stat_writer), started daemon 131078133236224)>, <Thread(Rabbit-heartbeat, started daemon 131078133539840)>, <Thread(Thread-5 (_runner), started daemon 131078133077696)>, <Thread(Thread-7 (_runner), started daemon 131078131128384)>] {{(pid=75137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_service.periodic_task [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG cinder.volume.drivers.lvm [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Updating volume stats {{(pid=75137) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:48:43 devstack sudo[84676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 21:48:43 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:48:43 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:48:43 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:48:43 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:48:43 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:48:43 devstack sudo[84705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 21:48:43 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:48:43 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:48:43 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:48:43 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 21:48:43 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:48:44 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Sep 16 21:48:44 devstack cinder-volume[75137]: DEBUG oslo_concurrency.processutils [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:48:44 devstack cinder-volume[75137]: DEBUG cinder.manager [None req-20f54e35-39be-488e-a1c9-c8deb7dadd61 None None] Notifying Schedulers of capabilities ... {{(pid=75137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:48:53 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:SELECT=1 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:48:53 devstack cinder-volume[75137]: DEBUG dbcounter [-] [75137] Writing DB stats cinder:UPDATE=1 {{(pid=75137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:48:57 devstack cinder-volume[74983]: INFO oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Caught SIGTERM, stopping children
Sep 16 21:48:57 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Acquiring lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:48:57 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Acquired lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:48:57 devstack cinder-volume[74983]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Releasing lock "singleton_lock" {{(pid=74983) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:48:57 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Stop services. {{(pid=74983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 21:48:57 devstack cinder-volume[74983]: DEBUG oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Killing children. {{(pid=74983) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 21:48:57 devstack cinder-volume[74983]: INFO oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Waiting on 1 children to exit
Sep 16 21:49:02 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Acquiring lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:02 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Acquired lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:02 devstack cinder-volume[75137]: DEBUG oslo_concurrency.lockutils [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Releasing lock "singleton_lock" {{(pid=75137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:02 devstack cinder-volume[75137]: WARNING amqp [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 21:49:02 devstack cinder-volume[75137]: WARNING amqp [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 21:49:02 devstack cinder-volume[74983]: INFO oslo_service.backend._eventlet.service [None req-e97e442d-d571-43d3-b599-54c574ce0af4 None None] Child 75137 exited with status 0
Sep 16 21:49:02 devstack cinder-volume[85131]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 21:49:02 devstack cinder-volume[85131]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 21:49:02 devstack cinder-volume[85131]: we strongly recommend against using it for new projects.
Sep 16 21:49:02 devstack cinder-volume[85131]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 21:49:02 devstack cinder-volume[85131]: framework.  For more detail see
Sep 16 21:49:02 devstack cinder-volume[85131]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 21:49:02 devstack cinder-volume[85131]:   import eventlet  # noqa
Sep 16 21:49:04 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:04 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:04 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO dbcounter [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Registered counter for database cinder
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG dbcounter [-] [85131] Writer thread running {{(pid=85131) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO cinder.rpc [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO cinder.rpc [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO cinder.volume.manager [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Determined volume DB was empty at startup.
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG cinder.volume.manager [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85131) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO cinder.volume.manager [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 21:49:05 devstack cinder-volume[85131]: WARNING stevedore.named [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 21:49:05 devstack cinder-volume[85131]: WARNING castellan.key_manager [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:49:05 devstack cinder-volume[85131]: WARNING cinder.keymgr.conf_key_mgr [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO cinder.volume.manager [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85131) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:05 devstack cinder-volume[85131]: INFO oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Starting 1 workers
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Started child 85343 {{(pid=85131) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Full set of CONF: {{(pid=85131) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] ******************************************************************************** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Configuration options gathered from: {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] ================================================================================ {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] allow_availability_zone_fallback = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] allow_compression_on_image_upload = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] allowed_direct_url_schemes     = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] api_rate_limit                 = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] auth_strategy                  = keystone {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85343]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_availability_zone      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_host                   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_name                   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_stats_polling_interval = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backup_api_class               = cinder.backup.api.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backup_name_template           = backup-%s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backup_use_same_host           = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backup_use_temp_snapshot       = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] chap_password                  = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] chap_username                  =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_internal_tenant_project_id = c5560cc540f4467dacf14a927d698937 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:05 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_internal_tenant_user_id = 111e1bed28cf4ad9bbaa8dd45035fde2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cluster                        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] compression_format             = gzip {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] compute_api_class              = cinder.compute.nova.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] config_dir                     = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] config_source                  = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] control_exchange               = openstack {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] debug                          = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] default_availability_zone      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] default_group_type             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] default_volume_type            = QuobyteHD {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] disk_geometry                  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_client_cert             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_client_cert_key         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_data_namespace          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_ssl_cert_path           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_ssl_cert_verify         = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] driver_use_ssl                 = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] enable_new_services            = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] enable_unsupported_driver      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] enabled_backends               = ['QuobyteHD'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] enforce_multipath_for_image_xfer = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] filter_function                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_api_insecure            = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_api_servers             = ['http://192.168.122.194/image'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_api_ssl_compression     = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_ca_certificates_file    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_catalog_info            = image:glance:publicURL {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_certfile                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_keyfile                 = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_num_retries             = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance_request_timeout         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] goodness_function              = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] graceful_shutdown_timeout      = 5 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] group_api_class                = cinder.group.api.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] host                           = devstack {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_compress_on_upload       = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_conversion_address_space_limit = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_conversion_cpu_limit     = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_conversion_disable       = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_introspection_address_space_limit = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_introspection_cpu_limit  = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_upload_use_cinder_backend = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_upload_use_internal_tenant = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_volume_cache_enabled     = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_volume_cache_max_count   = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] image_volume_cache_max_size_gb = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] init_host_max_objects_retrieval = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] instance_format                = [instance: %(uuid)s]  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85343]: INFO cinder.volume.manager [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.remotefs [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85343) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iscsi_target_flags             =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iscsi_write_cache              = on {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iser_helper                    = tgtadm {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iser_ip_address                = 192.168.122.194 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iser_port                      = 3260 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_color                      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_config_append              = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_dir                        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_file                       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_options                    = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_rotate_interval            = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_rotate_interval_type       = days {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] log_rotation_type              = none {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] max_age                        = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] max_logfile_count              = 30 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] max_logfile_size_mb            = 200 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] max_over_subscription_ratio    = 20.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] message_reap_interval          = 86400 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] message_ttl                    = 2592000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] migration_create_volume_timeout_secs = 300 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] monkey_patch                   = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] monkey_patch_modules           = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] my_ip                          = 192.168.122.194 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] no_snapshot_gb_quota           = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] num_iser_scan_tries            = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] num_shell_tries                = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] num_volume_device_scan_tries   = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] nvmeof_conn_info_version       = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] nvmet_ns_id                    = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] nvmet_port_id                  = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_max_limit                = 1000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_ext_list          = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_listen_port       = 8776 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_use_ssl           = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] osapi_volume_workers           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] per_volume_size_limit          = -1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] periodic_fuzzy_delay           = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] periodic_interval              = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] public_endpoint                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] publish_errors                 = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_backup_gigabytes         = 1000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_backups                  = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_gigabytes                = 1000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_groups                   = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_snapshots                = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] quota_volumes                  = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] rate_limit_burst               = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] rate_limit_except_level        = CRITICAL {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] rate_limit_interval            = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] reinit_driver_count            = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] replication_device             = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] report_discard_supported       = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] report_interval                = 120 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] reservation_clean_interval     = 86400 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] reservation_expire             = 86400 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] reserved_image_namespaces      = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] reserved_percentage            = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] rpc_response_timeout           = 120 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] run_external_periodic_tasks    = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] scst_target_driver             = iscsi {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] scst_target_iqn_name           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_down_time              = 720 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] shell_completion               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] snapshot_name_template         = snapshot-%s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] split_loggers                  = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] state_path                     = /opt/stack/data/cinder {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] storage_availability_zone      = nova {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] storage_protocol               = iSCSI {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] syslog_log_facility            = LOG_USER {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_helper                  = lioadm {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_ip_address              = 192.168.122.194 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_port                    = 3260 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_protocol                = iscsi {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] target_secondary_ip_addresses  = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] trace_flags                    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] transport_url                  = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] until_refresh                  = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_chap_auth                  = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_default_quota_class        = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_journal                    = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_json                       = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_multipath_for_image_xfer   = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_stderr                     = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] use_syslog                     = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] verify_glance_signatures       = enabled {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_api_class               = cinder.volume.api.API {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_backend_name            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_clear                   = zero {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_clear_ionice            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_clear_size              = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_copy_bps_limit          = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_dd_blocksize            = 1M {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_name_template           = volume-%s {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_service_inithost_offload = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volume_usage_audit_period      = month {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] zoning_mode                    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_concurrency.disable_process_locking = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.auth_section = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.auth_type   = password {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.auth_version = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.cache       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.certfile    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.delay_auth_decision = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.http_connect_timeout = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.include_service_catalog = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.insecure    = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85343) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.interface   = public {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85343]: WARNING cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.keyfile     = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_password = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85343]: WARNING cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Running cmd (subprocess): mount.quobyte {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcache_username = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.region_name = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.service_token_roles_required = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.service_type = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.token_cache_time = 300 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.backend                  = dogpile.cache.null {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.backend_argument         = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.backend_expiration_time  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.config_prefix            = cache.oslo {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.debug_cache_backend      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.enable_retry_client      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.enable_socket_keepalive  = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.enabled                  = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.expiration_time          = 600 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.hashclient_retry_attempts = 2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_dead_retry      = 300 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_pool_maxsize    = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_sasl_enabled    = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.password                 = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.proxies                  = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.redis_db                 = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.redis_sentinel_service_name = mymaster {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.redis_server             = localhost:6379 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.retry_attempts           = 2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.retry_delay              = 0.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.socket_keepalive_count   = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.socket_keepalive_idle    = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.socket_keepalive_interval = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.socket_timeout           = 1.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.tls_allowed_ciphers      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.tls_cafile               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.tls_certfile             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.tls_enabled              = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.tls_keyfile              = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cache.username                 = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] coordination.backend_url       = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.asyncio_connection    = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.asyncio_slave_connection = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.backend               = sqlalchemy {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.connection            = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.connection_debug      = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.connection_parameters =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.connection_recycle_time = 3600 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.connection_trace      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.db_inc_retry_interval = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.db_max_retries        = 20 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.db_max_retry_interval = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.db_retry_interval     = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.max_overflow          = 50 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.max_pool_size         = 5 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.max_retries           = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.mysql_wsrep_sync_wait = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.pool_timeout          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.retry_interval        = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.slave_connection      = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.sqlite_synchronous    = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.synchronous_reader    = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] database.use_db_reconnect      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_tracing.insecure = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.connection_string     = messaging:// {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.enabled               = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.es_doc_type           = notification {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.es_scroll_size        = 10000 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.es_scroll_time        = 2m {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.filter_error_trace    = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.hmac_keys             = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.sentinel_service_name = mymaster {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.socket_timeout        = 0.1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.trace_requests        = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler.trace_sqlalchemy      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler_jaeger.process_tags   = {} {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler_jaeger.service_name_prefix = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] profiler_otlp.service_name_prefix = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.enforce_new_defaults = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.policy_default_rule = default {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.policy_file        = policy.yaml {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.group          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.helper_command = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] privsep_osbrick.user           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.group         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.helper_command = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] cinder_sys_admin.user          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.auth_section      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.auth_type         = password {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.cafile            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.certfile          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.collect_timing    = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.insecure          = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.keyfile           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.send_service_user_token = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.split_loggers     = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.timeout           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.tls_ciphers       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] service_user.tls_min_version   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.auth_section            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.auth_type               = password {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.certfile                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.collect_timing          = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.insecure                = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.keyfile                 = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.region_name             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.split_loggers           = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.timeout                 = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.tls_ciphers             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] glance.tls_min_version         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.backend_availability_zone = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.chap_password = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.chap_username =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.disk_geometry = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_client_cert = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_client_cert_key = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_data_namespace = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.driver_use_ssl = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.enable_unsupported_driver = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.extra_capabilities = {} {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.filter_function = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.goodness_function = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iscsi_target_flags =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iscsi_write_cache = on {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iser_helper   = tgtadm {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iser_port     = 3260 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_host      =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_login     = admin {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_mount_options = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_password  = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_private_key =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_share_path =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.num_shell_tries = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.nvmet_port_id = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_client_cfg = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.quobyte_volume_url = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.replication_device = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.report_discard_supported = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.reserved_percentage = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.scst_target_driver = iscsi {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.scst_target_iqn_name = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.storage_protocol = iSCSI {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_helper = tgtadm {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_port   = 3260 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_protocol = iscsi {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.trace_flags   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.unique_fqdn_network = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.use_chap_auth = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_backend_name = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_clear  = zero {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_clear_ionice = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_clear_size = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_reports.file_event_handler = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_reports.log_dir           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.backend_availability_zone = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.backend_host         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.chap_password        = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.chap_username        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.chiscsi_conf         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.disk_geometry        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_client_cert   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_client_cert_key = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_data_namespace = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.driver_use_ssl       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.extra_capabilities   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.filter_function      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.goodness_function    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iser_helper          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iser_ip_address      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iser_port            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.iser_target_prefix   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_host             = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_login            = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_mount_options    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_password         = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_private_key      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_share_path       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_ssh_port         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.num_shell_tries      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.nvmet_port_id        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.replication_device   = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.report_discard_supported = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.reserved_percentage  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.scst_target_driver   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.storage_protocol     = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_helper        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_ip_address    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_port          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_prefix        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_protocol      = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.trace_flags          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.use_chap_auth        = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_clear         = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_clear_size    = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] QuobyteHD.volumes_dir          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl      = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_notifications.driver = [] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_notifications.retry = -1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] oslo_messaging_notifications.transport_url = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] key_manager.fixed_key          = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.barbican_api_version  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.barbican_endpoint     = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.barbican_endpoint_type = public {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.barbican_region_name  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.cafile                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.certfile              = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.collect_timing        = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.insecure              = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.keyfile               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.number_of_retries     = 60 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.retry_delay           = 1 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.send_service_user_token = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.split_loggers         = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.timeout               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.tls_ciphers           = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.tls_min_version       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.verify_ssl            = True {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican.verify_ssl_path       = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.auth_section = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.auth_type = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.cafile   = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.certfile = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.collect_timing = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.insecure = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.keyfile  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.split_loggers = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.timeout  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.tls_ciphers = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] barbican_service_user.tls_min_version = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.approle_role_id          = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.approle_secret_id        = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.auth_method              = approle {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] CMD "mount.quobyte" returned: 1 in 0.140s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.auth_path                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.kv_mountpoint            = secret {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.kv_path                  = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.kv_version               = 2 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.namespace                = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.root_token_id            = **** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.ssl_ca_crt_file          = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.timeout                  = 60.0 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.token_file               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.token_role               = None {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.use_ssl                  = False {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:06 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] ******************************************************************************** {{(pid=85131) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85343) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:06 devstack cinder-volume[85343]: INFO cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c ...
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 -c /etc/quobyte/client-cinder.cfg {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:06 devstack sudo[85349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 -c /etc/quobyte/client-cinder.cfg
Sep 16 21:49:06 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:06 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:06 devstack cinder-volume[85343]: INFO cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c succeeded
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85343) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:06 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:06 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:06 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.252s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:06 devstack cinder-volume[85343]: INFO cinder.volume.driver [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 21:49:06 devstack cinder-volume[85343]: DEBUG cinder.volume.driver [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85343) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_db.sqlalchemy.engines [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85343) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG dbcounter [-] [85343] Writer thread running {{(pid=85343) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG cinder.db.api [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Building query based on filter {{(pid=85343) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG cinder.image.image_utils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85343) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 21:49:07 devstack cinder-volume[85343]: INFO cinder.keymgr.migration [None req-bc0d2520-3fbd-446b-aae6-8308a06baa4f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85343) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG cinder.volume.drivers.quobyte [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85343) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85343) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:07 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:07 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:07 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.processutils [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.238s {{(pid=85343) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG cinder.manager [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Notifying Schedulers of capabilities ... {{(pid=85343) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Unable to connect to AMQP server on 192.168.122.194:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service [None req-9a9e54dd-ce32-4f0e-97d7-c613719e29be None None] Error starting thread.: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.194:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service Traceback (most recent call last):
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     ret, channel = autoretry_method()
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service                    ^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return fun(*args, **kwargs)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     method()
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self._producer.publish(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return _publish(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return channel.basic_publish(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.connection.drain_events(timeout=timeout)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     while not self.blocking_read(timeout):
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return self.on_inbound_frame(frame)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     callback(channel, method_sig, buf, None)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return self.channels[channel_id].dispatch_method(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     listener(*args)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     raise error_for_code(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service 
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service During handling of the above exception, another exception occurred:
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service 
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service Traceback (most recent call last):
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py", line 721, in run_service
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     service.start()
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/service.py", line 228, in start
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.manager.init_host(added_to_cluster=self.added_to_cluster,
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/volume/manager.py", line 500, in init_host
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self._init_host(added_to_cluster, **kwargs)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/volume/manager.py", line 637, in _init_host
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.publish_service_capabilities(ctxt)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self._publish_service_capabilities(context)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.scheduler_rpcapi.update_service_capabilities(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.transport._send(
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return self._driver.send(target, ctxt, message,
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     conn.fanout_send(target.topic, msg, retry=retry)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service     raise exceptions.MessageDeliveryFailure(msg)
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.194:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 16 21:49:07 devstack cinder-volume[85343]: ERROR oslo_service.backend._eventlet.service 
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquiring lock "singleton_lock" {{(pid=85343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquired lock "singleton_lock" {{(pid=85343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:07 devstack cinder-volume[85343]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Releasing lock "singleton_lock" {{(pid=85343) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:07 devstack cinder-volume[85131]: INFO oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Child 85343 exited with status 1
Sep 16 21:49:07 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Started child 85454 {{(pid=85131) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 21:49:07 devstack cinder-volume[85454]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 21:49:07 devstack cinder-volume[85454]: INFO cinder.volume.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.remotefs [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85454) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85454) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 21:49:07 devstack cinder-volume[85454]: WARNING cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 21:49:07 devstack cinder-volume[85454]: WARNING cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Running cmd (subprocess): mount.quobyte {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:07 devstack sudo[85456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:07 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:07 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.254s {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:07 devstack cinder-volume[85454]: INFO cinder.volume.driver [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.volume.driver [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85454) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG oslo_db.sqlalchemy.engines [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG dbcounter [-] [85454] Writer thread running {{(pid=85454) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:49:07 devstack cinder-volume[85454]: DEBUG cinder.db.api [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Building query based on filter {{(pid=85454) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.image.image_utils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85454) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.keymgr.migration [None req-ab2b9789-2624-4da4-88a6-84bd59b4659c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:08 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:08 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:08 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.265s {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Notifying Schedulers of capabilities ... {{(pid=85454) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.volume.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Driver initialization completed successfully.
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Initiating service 3 cleanup
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Service 3 cleanup completed.
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.service [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Creating RPC server for service cinder-volume {{(pid=85454) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.service [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85454) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.volume.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85454) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG cinder.volume.drivers.quobyte [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85454) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85454) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:08 devstack sudo[85490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:08 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:08 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:08 devstack cinder-volume[85454]: DEBUG oslo_concurrency.processutils [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.326s {{(pid=85454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:08 devstack cinder-volume[85454]: INFO cinder.volume.manager [None req-32085703-3f81-460a-a5c7-ff9807678e47 None None] Driver post RPC initialization completed successfully.
Sep 16 21:49:11 devstack cinder-volume[85131]: INFO oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Caught SIGTERM, stopping children
Sep 16 21:49:11 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquiring lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:11 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquired lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:11 devstack cinder-volume[85131]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Releasing lock "singleton_lock" {{(pid=85131) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:11 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Stop services. {{(pid=85131) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 21:49:11 devstack cinder-volume[85131]: DEBUG oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Killing children. {{(pid=85131) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 21:49:11 devstack cinder-volume[85131]: INFO oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Waiting on 1 children to exit
Sep 16 21:49:12 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquiring lock "singleton_lock" {{(pid=85454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:12 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Acquired lock "singleton_lock" {{(pid=85454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:12 devstack cinder-volume[85454]: DEBUG oslo_concurrency.lockutils [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Releasing lock "singleton_lock" {{(pid=85454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:12 devstack cinder-volume[85454]: WARNING amqp [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 21:49:12 devstack cinder-volume[85454]: WARNING amqp [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 21:49:12 devstack cinder-volume[85131]: INFO oslo_service.backend._eventlet.service [None req-9e9916f2-7ce8-48d4-b389-a01c8380dbcc None None] Child 85454 exited with status 0
Sep 16 21:49:13 devstack cinder-volume[85656]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 21:49:13 devstack cinder-volume[85656]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 21:49:13 devstack cinder-volume[85656]: we strongly recommend against using it for new projects.
Sep 16 21:49:13 devstack cinder-volume[85656]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 21:49:13 devstack cinder-volume[85656]: framework.  For more detail see
Sep 16 21:49:13 devstack cinder-volume[85656]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 21:49:13 devstack cinder-volume[85656]:   import eventlet  # noqa
Sep 16 21:49:16 devstack cinder-volume[85656]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 21:49:16 devstack cinder-volume[85656]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 21:49:16 devstack cinder-volume[85656]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85656) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 21:49:17 devstack cinder-volume[85656]: INFO dbcounter [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Registered counter for database cinder
Sep 16 21:49:17 devstack cinder-volume[85656]: DEBUG oslo_db.sqlalchemy.engines [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG dbcounter [-] [85656] Writer thread running {{(pid=85656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:49:18 devstack cinder-volume[85656]: INFO cinder.rpc [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 21:49:18 devstack cinder-volume[85656]: INFO cinder.rpc [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_db.sqlalchemy.engines [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:18 devstack cinder-volume[85656]: INFO cinder.volume.manager [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Determined volume DB was empty at startup.
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG cinder.volume.manager [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85656) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 21:49:18 devstack cinder-volume[85656]: WARNING stevedore.named [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 21:49:18 devstack cinder-volume[85656]: WARNING castellan.key_manager [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:49:18 devstack cinder-volume[85656]: WARNING cinder.keymgr.conf_key_mgr [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 21:49:18 devstack cinder-volume[85656]: INFO cinder.volume.manager [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_db.sqlalchemy.engines [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:18 devstack cinder-volume[85656]: INFO oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Starting 1 workers
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Started child 85936 {{(pid=85656) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Full set of CONF: {{(pid=85656) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] ******************************************************************************** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] Configuration options gathered from: {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] ================================================================================ {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] allow_availability_zone_fallback = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] allow_compression_on_image_upload = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] allowed_direct_url_schemes     = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] api_rate_limit                 = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] auth_strategy                  = keystone {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_availability_zone      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_host                   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_name                   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_stats_polling_interval = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backup_api_class               = cinder.backup.api.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backup_name_template           = backup-%s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backup_use_same_host           = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backup_use_temp_snapshot       = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] chap_password                  = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] chap_username                  =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_internal_tenant_project_id = c5560cc540f4467dacf14a927d698937 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_internal_tenant_user_id = 111e1bed28cf4ad9bbaa8dd45035fde2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cluster                        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] compression_format             = gzip {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] config_dir                     = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] config_source                  = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] control_exchange               = openstack {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] debug                          = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] default_availability_zone      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] default_group_type             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] default_volume_type            = QuobyteHD {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] disk_geometry                  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_client_cert             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_client_cert_key         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_data_namespace          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_ssl_cert_path           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_ssl_cert_verify         = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] driver_use_ssl                 = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] enable_new_services            = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] enable_unsupported_driver      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] enforce_multipath_for_image_xfer = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] filter_function                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_api_insecure            = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_api_servers             = ['http://192.168.122.194/image'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_api_ssl_compression     = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_ca_certificates_file    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85936]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_certfile                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_keyfile                 = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_num_retries             = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance_request_timeout         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] goodness_function              = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] graceful_shutdown_timeout      = 5 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] group_api_class                = cinder.group.api.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] host                           = devstack {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_compress_on_upload       = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_conversion_address_space_limit = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_conversion_cpu_limit     = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_conversion_disable       = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_introspection_address_space_limit = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_introspection_cpu_limit  = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_upload_use_cinder_backend = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_upload_use_internal_tenant = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_volume_cache_enabled     = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_volume_cache_max_count   = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] image_volume_cache_max_size_gb = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] init_host_max_objects_retrieval = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iscsi_target_flags             =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iscsi_write_cache              = on {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iser_helper                    = tgtadm {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iser_ip_address                = 192.168.122.194 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iser_port                      = 3260 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_color                      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_config_append              = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_dir                        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_file                       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_options                    = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_rotate_interval            = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_rotate_interval_type       = days {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] log_rotation_type              = none {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] max_age                        = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] max_logfile_count              = 30 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] max_logfile_size_mb            = 200 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] max_over_subscription_ratio    = 20.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] message_reap_interval          = 86400 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] message_ttl                    = 2592000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] migration_create_volume_timeout_secs = 300 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] monkey_patch                   = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] monkey_patch_modules           = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] my_ip                          = 192.168.122.194 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] no_snapshot_gb_quota           = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] num_iser_scan_tries            = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] num_shell_tries                = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] num_volume_device_scan_tries   = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] nvmeof_conn_info_version       = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] nvmet_ns_id                    = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] nvmet_port_id                  = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_max_limit                = 1000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_ext_list          = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_listen_port       = 8776 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_use_ssl           = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] osapi_volume_workers           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] per_volume_size_limit          = -1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] periodic_fuzzy_delay           = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] periodic_interval              = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] public_endpoint                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] publish_errors                 = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_backup_gigabytes         = 1000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_backups                  = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_gigabytes                = 1000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_groups                   = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_snapshots                = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] quota_volumes                  = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] rate_limit_burst               = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] rate_limit_except_level        = CRITICAL {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] rate_limit_interval            = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] reinit_driver_count            = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] replication_device             = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] report_discard_supported       = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] report_interval                = 120 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] reservation_clean_interval     = 86400 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] reservation_expire             = 86400 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] reserved_image_namespaces      = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] reserved_percentage            = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] rpc_response_timeout           = 120 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] run_external_periodic_tasks    = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] scst_target_driver             = iscsi {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] scst_target_iqn_name           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_down_time              = 720 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] shell_completion               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] snapshot_name_template         = snapshot-%s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] split_loggers                  = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] state_path                     = /opt/stack/data/cinder {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] storage_availability_zone      = nova {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] storage_protocol               = iSCSI {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] syslog_log_facility            = LOG_USER {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_helper                  = lioadm {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_ip_address              = 192.168.122.194 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_port                    = 3260 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_protocol                = iscsi {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] target_secondary_ip_addresses  = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] trace_flags                    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] transport_url                  = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] until_refresh                  = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_chap_auth                  = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_default_quota_class        = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_journal                    = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_json                       = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_multipath_for_image_xfer   = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_stderr                     = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] use_syslog                     = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] verify_glance_signatures       = enabled {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_api_class               = cinder.volume.api.API {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_backend_name            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_clear                   = zero {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_clear_ionice            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_clear_size              = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_copy_bps_limit          = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_dd_blocksize            = 1M {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_name_template           = volume-%s {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_service_inithost_offload = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volume_usage_audit_period      = month {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] zoning_mode                    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_concurrency.disable_process_locking = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.auth_section = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.auth_type   = password {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.auth_version = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.cache       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.certfile    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.include_service_catalog = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.insecure    = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.interface   = public {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.keyfile     = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_password = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcache_username = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.region_name = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.service_type = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.backend                  = dogpile.cache.null {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.backend_argument         = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.backend_expiration_time  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.config_prefix            = cache.oslo {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.debug_cache_backend      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.enable_retry_client      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.enable_socket_keepalive  = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.enabled                  = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.expiration_time          = 600 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.hashclient_retry_attempts = 2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_dead_retry      = 300 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_sasl_enabled    = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.password                 = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.proxies                  = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.redis_db                 = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.redis_server             = localhost:6379 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.retry_attempts           = 2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.retry_delay              = 0.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.socket_keepalive_count   = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.socket_keepalive_idle    = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.socket_keepalive_interval = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.socket_timeout           = 1.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.tls_allowed_ciphers      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.tls_cafile               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.tls_certfile             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.tls_enabled              = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.tls_keyfile              = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cache.username                 = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] coordination.backend_url       = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.asyncio_connection    = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.asyncio_slave_connection = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.backend               = sqlalchemy {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.connection            = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.connection_debug      = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.connection_parameters =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.connection_recycle_time = 3600 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.connection_trace      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.db_inc_retry_interval = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.db_max_retries        = 20 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.db_max_retry_interval = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.db_retry_interval     = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.max_overflow          = 50 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.max_pool_size         = 5 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.max_retries           = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.mysql_wsrep_sync_wait = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.pool_timeout          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.retry_interval        = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.slave_connection      = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.sqlite_synchronous    = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.synchronous_reader    = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] database.use_db_reconnect      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_tracing.insecure = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.connection_string     = messaging:// {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.enabled               = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.es_doc_type           = notification {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.es_scroll_size        = 10000 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.es_scroll_time        = 2m {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.filter_error_trace    = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.hmac_keys             = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.sentinel_service_name = mymaster {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.socket_timeout        = 0.1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.trace_requests        = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler.trace_sqlalchemy      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler_jaeger.process_tags   = {} {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler_jaeger.service_name_prefix = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] profiler_otlp.service_name_prefix = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.enforce_new_defaults = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.policy_default_rule = default {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.group          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.helper_command = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] privsep_osbrick.user           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.group         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.helper_command = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] cinder_sys_admin.user          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.auth_section      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.auth_type         = password {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.cafile            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.certfile          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.collect_timing    = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.insecure          = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.keyfile           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.send_service_user_token = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.split_loggers     = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.timeout           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.tls_ciphers       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] service_user.tls_min_version   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.auth_section            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.auth_type               = password {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.certfile                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.collect_timing          = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.insecure                = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.keyfile                 = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.region_name             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.split_loggers           = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.timeout                 = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.tls_ciphers             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] glance.tls_min_version         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.backend_availability_zone = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.chap_password = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.chap_username =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.disk_geometry = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_client_cert = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_client_cert_key = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_data_namespace = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.driver_use_ssl = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.extra_capabilities = {} {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.filter_function = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.goodness_function = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iscsi_target_flags =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iscsi_write_cache = on {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iser_port     = 3260 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_host      =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_login     = admin {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_mount_options = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_password  = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_private_key =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85936) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_share_path =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.num_shell_tries = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.quobyte_volume_url = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.replication_device = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.report_discard_supported = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.reserved_percentage = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_helper = tgtadm {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_port   = 3260 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_protocol = iscsi {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.trace_flags   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.unique_fqdn_network = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.use_chap_auth = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_backend_name = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_clear  = zero {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_clear_ionice = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_clear_size = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_reports.file_event_handler = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_reports.log_dir           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.backend_availability_zone = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.backend_host         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.chap_password        = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack quobyte-client[85939]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.chap_username        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.disk_geometry        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_client_cert   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_data_namespace = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack quobyte-client[85939]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.extra_capabilities   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.filter_function      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.goodness_function    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iser_helper          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iser_ip_address      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iser_port            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_host             = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_login            = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_mount_options    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_password         = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_private_key      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_share_path       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.num_shell_tries      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.replication_device   = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.report_discard_supported = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.reserved_percentage  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.scst_target_driver   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.storage_protocol     = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_helper        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_ip_address    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_port          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_prefix        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_protocol      = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.trace_flags          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.use_chap_auth        = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_clear         = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_clear_size    = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] QuobyteHD.volumes_dir          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_notifications.driver = [] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_notifications.retry = -1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85936) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 21:49:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 21:49:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Running cmd (subprocess): mount.quobyte {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] key_manager.fixed_key          = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.barbican_api_version  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.barbican_endpoint     = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.barbican_endpoint_type = public {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.barbican_region_name  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.cafile                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.certfile              = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.collect_timing        = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.insecure              = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.keyfile               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.number_of_retries     = 60 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.retry_delay           = 1 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.send_service_user_token = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.split_loggers         = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.timeout               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.tls_ciphers           = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.tls_min_version       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.verify_ssl            = True {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican.verify_ssl_path       = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.auth_section = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.auth_type = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.cafile   = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.certfile = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.collect_timing = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.insecure = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.keyfile  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.split_loggers = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.timeout  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.tls_ciphers = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] barbican_service_user.tls_min_version = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.approle_role_id          = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.approle_secret_id        = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.auth_method              = approle {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.auth_path                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.kv_mountpoint            = secret {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.kv_path                  = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.kv_version               = 2 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.namespace                = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.root_token_id            = **** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.ssl_ca_crt_file          = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.timeout                  = 60.0 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.token_file               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.token_role               = None {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.use_ssl                  = False {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 21:49:18 devstack cinder-volume[85656]: DEBUG oslo_service.backend._eventlet.service [None req-6ff67832-9678-4e32-9cc2-9d184e391a71 None None] ******************************************************************************** {{(pid=85656) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:18 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:18 devstack cinder-volume[85936]: INFO cinder.volume.driver [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 21:49:18 devstack cinder-volume[85936]: DEBUG cinder.volume.driver [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85936) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_db.sqlalchemy.engines [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writer thread running {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.db.api [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Building query based on filter {{(pid=85936) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85936) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.keymgr.migration [None req-0c800870-6d43-46a0-baeb-be2dba846a7b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 21:49:19 devstack sudo[85955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:19 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:19 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.312s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Driver initialization completed successfully.
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Initiating service 3 cleanup
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Service 3 cleanup completed.
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.service [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Creating RPC server for service cinder-volume {{(pid=85936) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.service [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85936) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:49:19 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:49:19 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:49:19 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Sep 16 21:49:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:49:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a630908a-5cb3-4770-a740-6017e91dbc8f None None] Driver post RPC initialization completed successfully.
Sep 16 21:49:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:49:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 6 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:49:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:49:28 devstack cinder-volume[85656]: DEBUG dbcounter [-] [85656] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85656) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:49:29 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=3 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:49:29 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Flow 'volume_create_manager' (dd23e099-57eb-4ec6-965b-c3450d6a5e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521d53f-2cd1-4c15-a7bc-9a26843853ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0521d53f-2cd1-4c15-a7bc-9a26843853ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1334107692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8277424a-265b-4ca3-9bbe-8f8c1f54a5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10442a723cc24ced9317a84729dfdd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:18Z,use_quota=True,user_id='e4577b084f2b4898acec67e0d769b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239bca4-4847-42d2-a900-4020efdc4bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239bca4-4847-42d2-a900-4020efdc4bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdb90aa-7bee-4f6a-aea4-c65b639c08f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdb90aa-7bee-4f6a-aea4-c65b639c08f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8277424a-265b-4ca3-9bbe-8f8c1f54a5c1', 'volume_name': 'volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64578bfd-be31-40af-9080-3af1dfd5f980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64578bfd-be31-40af-9080-3af1dfd5f980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46fffa-7495-4c44-b49a-528f0ad32aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Volume 8277424a-265b-4ca3-9bbe-8f8c1f54a5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1', 'volume_size': 1}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1334107692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8277424a-265b-4ca3-9bbe-8f8c1f54a5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10442a723cc24ced9317a84729dfdd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:18Z,use_quota=True,user_id='e4577b084f2b4898acec67e0d769b985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Creating volume 8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:50:18 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:50:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:18 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 1073741824
Sep 16 21:50:18 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:19 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 1073741824" returned: 0 in 1.196s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:20 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1
Sep 16 21:50:20 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:20 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" returned: 0 in 0.549s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46fffa-7495-4c44-b49a-528f0ad32aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc28f802-24f1-4a93-897f-bf6d83ec9afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:20 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Volume volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 (8277424a-265b-4ca3-9bbe-8f8c1f54a5c1): created successfully
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc28f802-24f1-4a93-897f-bf6d83ec9afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Flow 'volume_create_manager' (dd23e099-57eb-4ec6-965b-c3450d6a5e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a576b358-7ffe-4016-a7b2-47ce140ff289 tempest-TaggedAttachmentsTest-500869682 None] Created volume successfully.
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:22 devstack sudo[86989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:50:22 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:22 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.578s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:50:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:50:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 6 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:50:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Flow 'volume_create_manager' (6197573d-2cbe-48f4-8d20-3107b08bb124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482f8b69-e574-4434-a673-cf310c35d7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482f8b69-e574-4434-a673-cf310c35d7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-646552017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58227b8-1b75-44fc-801b-9a08146f3c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52059c0925c2420cb6967c309e4cbb87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:31Z,use_quota=True,user_id='136813d5576a4a3eb9c2ca497923967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228f95f3-4920-47d5-8c6a-f6f34d8d24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228f95f3-4920-47d5-8c6a-f6f34d8d24c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a1ee1-2905-40f4-bc51-6c1710b4ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a1ee1-2905-40f4-bc51-6c1710b4ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58227b8-1b75-44fc-801b-9a08146f3c79', 'volume_name': 'volume-c58227b8-1b75-44fc-801b-9a08146f3c79', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91faf701-7f4c-412f-b4f3-ed42c6aa5af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91faf701-7f4c-412f-b4f3-ed42c6aa5af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe737df-9e04-411d-8254-499318361a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:30 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Volume c58227b8-1b75-44fc-801b-9a08146f3c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58227b8-1b75-44fc-801b-9a08146f3c79', 'volume_size': 1}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-646552017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58227b8-1b75-44fc-801b-9a08146f3c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52059c0925c2420cb6967c309e4cbb87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:31Z,use_quota=True,user_id='136813d5576a4a3eb9c2ca497923967c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Creating volume c58227b8-1b75-44fc-801b-9a08146f3c79 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:50:31 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:31 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 1073741824
Sep 16 21:50:31 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:31 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 1073741824" returned: 0 in 0.918s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:32 devstack sudo[87124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79
Sep 16 21:50:32 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:32 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79" returned: 0 in 0.801s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe737df-9e04-411d-8254-499318361a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58227b8-1b75-44fc-801b-9a08146f3c79', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deafa2c0-c2e3-4805-9e55-35167cbbb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Volume volume-c58227b8-1b75-44fc-801b-9a08146f3c79 (c58227b8-1b75-44fc-801b-9a08146f3c79): created successfully
Sep 16 21:50:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deafa2c0-c2e3-4805-9e55-35167cbbb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Flow 'volume_create_manager' (6197573d-2cbe-48f4-8d20-3107b08bb124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b8f38b0a-7591-4651-b9af-fc792383e39f tempest-DeleteServersTestJSON-196970874 None] Created volume successfully.
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Flow 'volume_create_manager' (8de316c5-c183-40cf-99de-fb55ab527264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b865c566-0162-40bf-80c0-99d1d5cc71cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b865c566-0162-40bf-80c0-99d1d5cc71cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1476800368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d909b6a-c228-4b08-b25a-e4ba6cb06a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867fae81e456406b9aa784e2f338f590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:38Z,use_quota=True,user_id='dfe111392b494b5fbc95a169cc0f430f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6148e40a-d3cf-404b-8899-ea923f3e3e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6148e40a-d3cf-404b-8899-ea923f3e3e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc868f20-4b4e-429f-bc28-b02f60112dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc868f20-4b4e-429f-bc28-b02f60112dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d909b6a-c228-4b08-b25a-e4ba6cb06a42', 'volume_name': 'volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933d847f-9d31-4238-a8c6-b99ea0672344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933d847f-9d31-4238-a8c6-b99ea0672344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f4b43d-175a-4fd6-a3d8-4eb4ff5ac84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:38 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Volume 9d909b6a-c228-4b08-b25a-e4ba6cb06a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42', 'volume_size': 1}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1476800368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d909b6a-c228-4b08-b25a-e4ba6cb06a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='867fae81e456406b9aa784e2f338f590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:50:38Z,use_quota=True,user_id='dfe111392b494b5fbc95a169cc0f430f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Creating volume 9d909b6a-c228-4b08-b25a-e4ba6cb06a42 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:50:39 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:50:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:39 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 1073741824
Sep 16 21:50:39 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:40 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 1073741824" returned: 0 in 1.042s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:40 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42
Sep 16 21:50:40 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:40 devstack cinder-volume[85936]: WARNING py.warnings [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 16 21:50:40 devstack cinder-volume[85936]:   .first()
Sep 16 21:50:40 devstack cinder-volume[85936]: 
Sep 16 21:50:40 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" returned: 0 in 0.546s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f4b43d-175a-4fd6-a3d8-4eb4ff5ac84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e5275-55c3-49ed-9903-f7e06298ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:50:40 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Volume volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 (9d909b6a-c228-4b08-b25a-e4ba6cb06a42): created successfully
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e5275-55c3-49ed-9903-f7e06298ab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Flow 'volume_create_manager' (8de316c5-c183-40cf-99de-fb55ab527264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:50:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-c58227b8-1b75-44fc-801b-9a08146f3c79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2353536f-3ec0-41ff-a5c9-03f73d4c8170', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:50:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-79167de9-bb91-4ceb-89ad-3d30e8dcc85b tempest-ServerRescueNegativeTestJSON-366971211 None] Created volume successfully.
Sep 16 21:50:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-731c4c61-b9bc-48d7-8331-032accd2c074 req-23fb5f6d-c2e1-4591-8f5b-65989379086f tempest-DeleteServersTestJSON-196970874 None] attachment_update completed successfully.
Sep 16 21:50:51 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=3 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:50:51 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=6,cinder:SELECT=11,cinder:INSERT=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:50:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-9d2e22b2-1d5c-40be-8b52-a16289ce5110 req-ace6e1e8-a370-4d42-8e1c-4956e06995bd tempest-DeleteServersTestJSON-196970874 None] Terminate volume connection completed successfully.
Sep 16 21:50:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-9d2e22b2-1d5c-40be-8b52-a16289ce5110 req-ace6e1e8-a370-4d42-8e1c-4956e06995bd tempest-DeleteServersTestJSON-196970874 None] Deleting attachment 2353536f-3ec0-41ff-a5c9-03f73d4c8170. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:50:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "cinder-c58227b8-1b75-44fc-801b-9a08146f3c79-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:50:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "cinder-c58227b8-1b75-44fc-801b-9a08146f3c79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:50:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "cinder-quobyte-c58227b8-1b75-44fc-801b-9a08146f3c79" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:50:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "cinder-quobyte-c58227b8-1b75-44fc-801b-9a08146f3c79" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:50:55 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3a_oytkv/privsep.sock']
Sep 16 21:50:55 devstack sudo[87933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3a_oytkv/privsep.sock
Sep 16 21:50:55 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 21:50:57 devstack cinder-volume[85936]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 16 21:50:57 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:57 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Spawned new privsep daemon via rootwrap
Sep 16 21:50:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Accepted privsep connection to /tmp/tmp3a_oytkv/privsep.sock {{(pid=85936) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 16 21:50:57 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 16 21:50:57 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 16 21:50:57 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 16 21:50:57 devstack cinder-volume[85936]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87951
Sep 16 21:50:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c9956-1c28-4e4b-a79b-a57eeb7bda79]: (2,) {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:50:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f373eb3c-69d2-40e1-932c-49ff001355b9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:50:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:57 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79
Sep 16 21:50:57 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Acquiring lock "cinder-9d909b6a-c228-4b08-b25a-e4ba6cb06a42-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "cinder-9d909b6a-c228-4b08-b25a-e4ba6cb06a42-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Acquiring lock "cinder-quobyte-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "cinder-quobyte-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a12606-db0f-4da5-9be4-734143bf9c6e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:58 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42
Sep 16 21:50:58 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:58 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79" returned: 0 in 0.724s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:58 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79
Sep 16 21:50:58 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:58 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c58227b8-1b75-44fc-801b-9a08146f3c79" returned: 0 in 0.432s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "cinder-quobyte-c58227b8-1b75-44fc-801b-9a08146f3c79" released by "delete_volume" :: held 3.279s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:50:58 devstack cinder-volume[85936]: WARNING cinder.quota [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:50:58 devstack cinder-volume[85936]: WARNING cinder.quota [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:50:58 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" returned: 0 in 0.792s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:59 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Created reservations ['e373af71-ae28-4f7e-87e4-e2229f56eeeb', 'f8f0595a-fa5b-4717-b6d0-ef03ac44c32c', '701b7ab9-a33d-4eeb-96ca-70c9ab445212', '8f397586-dd45-4b4e-92f4-5cd3ca16336e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:50:59 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:59 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:50:59 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:59 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "cinder-quobyte-9d909b6a-c228-4b08-b25a-e4ba6cb06a42" released by "delete_volume" :: held 1.319s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Created reservations ['3d9dccb7-99f0-46b2-894c-f2d76886a225', 'e691fd94-0b83-43be-a079-17de55d4fa1b', 'd0e8e9c4-5174-4f72-8daf-e97eadeab4f6', '2699ffea-5b3a-4e65-8a25-2300d13a6c7e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:50:59 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.472s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:50:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Deleted volume successfully.
Sep 16 21:50:59 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:50:59 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:50:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-825af1f1-52d0-481f-99a4-12965946ac8c tempest-DeleteServersTestJSON-196970874 None] Lock "cinder-c58227b8-1b75-44fc-801b-9a08146f3c79-delete_volume" released by "delete_volume" :: held 4.235s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:00 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.347s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:00 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Deleted volume successfully.
Sep 16 21:51:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7eed09d8-f832-4d8b-8631-0df48cc496f3 tempest-ServerRescueNegativeTestJSON-366971211 None] Lock "cinder-9d909b6a-c228-4b08-b25a-e4ba6cb06a42-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:09 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:51:10 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Flow 'volume_create_manager' (def8a1de-7381-415e-ba98-6ab938e22bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603ae31c-6e67-4e80-b0d1-26421afda127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603ae31c-6e67-4e80-b0d1-26421afda127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-840907154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e97010-7664-44af-a56f-983624378d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403a185e6af1457c9c1172e804fae631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:14Z,use_quota=True,user_id='82d9f3051ac94ee4a902a21cdaf6cac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e977b947-3530-440c-a664-d91452863dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e977b947-3530-440c-a664-d91452863dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec50c08-77b4-4d59-ab4a-d9432e6ed015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec50c08-77b4-4d59-ab4a-d9432e6ed015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e97010-7664-44af-a56f-983624378d2a', 'volume_name': 'volume-a5e97010-7664-44af-a56f-983624378d2a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e792fcf9-6427-488d-8281-31717b9b975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e792fcf9-6427-488d-8281-31717b9b975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d055b-06a5-483e-bc1c-3f07bddb477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Volume a5e97010-7664-44af-a56f-983624378d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e97010-7664-44af-a56f-983624378d2a', 'volume_size': 1}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-840907154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e97010-7664-44af-a56f-983624378d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403a185e6af1457c9c1172e804fae631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:14Z,use_quota=True,user_id='82d9f3051ac94ee4a902a21cdaf6cac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Creating volume a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:51:13 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:51:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:13 devstack sudo[88069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a 1073741824
Sep 16 21:51:13 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:14 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a 1073741824" returned: 0 in 0.597s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:14 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a
Sep 16 21:51:14 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:14 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880d055b-06a5-483e-bc1c-3f07bddb477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e97010-7664-44af-a56f-983624378d2a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b9d3a-33a8-438f-ac6b-06e50746fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Volume volume-a5e97010-7664-44af-a56f-983624378d2a (a5e97010-7664-44af-a56f-983624378d2a): created successfully
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09b9d3a-33a8-438f-ac6b-06e50746fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Flow 'volume_create_manager' (def8a1de-7381-415e-ba98-6ab938e22bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-0b8349ef-9b93-49ee-aa2d-9cd40f8b90ba req-af79e83d-9e5c-4d4a-9f86-f501bf0b72ac tempest-VolumesSnapshotsTestJSON-569349969 None] Created volume successfully.
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Creating offline snapshot 0129f43b-9a4e-4ec5-bccb-c68570e12978 of volume a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c194820-8ff7-42cc-8a5d-e21392f743cd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:16 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a
Sep 16 21:51:16 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:16 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a" returned: 0 in 0.411s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:16 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 1G
Sep 16 21:51:16 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:17 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 1G" returned: 0 in 0.712s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e97010-7664-44af-a56f-983624378d2a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:17 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e97010-7664-44af-a56f-983624378d2a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978
Sep 16 21:51:17 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:18 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5e97010-7664-44af-a56f-983624378d2a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978" returned: 0 in 0.520s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 is being set with open permissions: ugo+rw
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:18 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978
Sep 16 21:51:18 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:18 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978" returned: 0 in 0.304s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:18 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info
Sep 16 21:51:18 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:18 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info is being set with open permissions: ugo+rw
Sep 16 21:51:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:18 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info
Sep 16 21:51:18 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:19 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.info" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-0653cfce-a07d-4acd-a053-95dc9dfd24b6 req-d41d5076-0836-4917-97c6-b4f0e8160d76 tempest-VolumesSnapshotsTestJSON-569349969 None] Create snapshot completed successfully
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "cinder-0129f43b-9a4e-4ec5-bccb-c68570e12978-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-0129f43b-9a4e-4ec5-bccb-c68570e12978-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "cinder-quobyte-0129f43b-9a4e-4ec5-bccb-c68570e12978" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-0129f43b-9a4e-4ec5-bccb-c68570e12978" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Deleting offline snapshot 0129f43b-9a4e-4ec5-bccb-c68570e12978 of volume a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] snapshot_file for this snap is: volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b51146-4ad0-4980-9ae4-1802d2be35ad]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:19 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978
Sep 16 21:51:19 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:19 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978" returned: 0 in 0.501s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5e97010-7664-44af-a56f-983624378d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[470dc590-a763-41ae-8071-c810dd900109]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:20 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a
Sep 16 21:51:20 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:20 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a" returned: 0 in 0.407s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:20 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978
Sep 16 21:51:20 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:20 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978" returned: 0 in 0.415s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:20 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978
Sep 16 21:51:20 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:21 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a.0129f43b-9a4e-4ec5-bccb-c68570e12978" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-0129f43b-9a4e-4ec5-bccb-c68570e12978" released by "_delete_snapshot" :: held 1.788s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" released by "delete_snapshot" :: held 1.821s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:21 devstack cinder-volume[85936]: WARNING cinder.quota [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.quota [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Created reservations ['c88a99b2-39ab-4172-b001-f9abec987f59', 'ddaf7f87-af71-40b8-a26f-aa39624f2add', '5946e30c-4124-4dfa-9bea-5b5161167b59', '45bd8e3f-4fe2-424e-8101-cae24b4bcf03'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Delete snapshot completed successfully.
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-0ab22eba-9d33-4398-a181-436ecd1ab15f req-8f18b5d8-91b3-439a-ae45-5fc303de4879 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-0129f43b-9a4e-4ec5-bccb-c68570e12978-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "cinder-a5e97010-7664-44af-a56f-983624378d2a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-a5e97010-7664-44af-a56f-983624378d2a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fe1449-9fcb-4c58-9e54-1751fc517186]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:21 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a
Sep 16 21:51:21 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:22 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:51:22 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:22 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:22 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a" returned: 0 in 0.507s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:22 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a
Sep 16 21:51:22 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:22 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5e97010-7664-44af-a56f-983624378d2a" returned: 0 in 0.339s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-quobyte-a5e97010-7664-44af-a56f-983624378d2a" released by "delete_volume" :: held 1.007s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG cinder.quota [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Created reservations ['e07bcc84-61f8-4362-b297-6712e392f867', '95100255-a545-4395-8e2d-87539e20df42', '31ce820f-542a-41d9-87bc-210e62017b2a', 'd32b43e6-ea15-42a5-b7ea-b3f8d0818c78'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:23 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:51:23 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:23 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.460s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:23 devstack cinder-volume[85936]: DEBUG cinder.manager [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Deleted volume successfully.
Sep 16 21:51:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-8e488f50-e60f-475c-aee6-f459ba34703f req-34ec5e8d-169a-488c-a740-4c2b35723e18 tempest-VolumesSnapshotsTestJSON-569349969 None] Lock "cinder-a5e97010-7664-44af-a56f-983624378d2a-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fddc3cc4-670a-47c0-a539-a8e66b212e7f req-c5298458-f080-4c8e-903f-a093623b2774 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fddc3cc4-670a-47c0-a539-a8e66b212e7f req-c5298458-f080-4c8e-903f-a093623b2774 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fddc3cc4-670a-47c0-a539-a8e66b212e7f req-c5298458-f080-4c8e-903f-a093623b2774 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-fddc3cc4-670a-47c0-a539-a8e66b212e7f req-c5298458-f080-4c8e-903f-a093623b2774 tempest-TaggedAttachmentsTest-500869682 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a936500-0e2c-4e86-a5db-a81384b89d0c', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:51:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-fddc3cc4-670a-47c0-a539-a8e66b212e7f req-c5298458-f080-4c8e-903f-a093623b2774 tempest-TaggedAttachmentsTest-500869682 None] attachment_update completed successfully.
Sep 16 21:51:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-be2feb61-a86c-446a-afd6-6991b1080ce2 req-483c0fb1-5f86-4c4d-9fe9-af7502c7f017 tempest-TaggedAttachmentsTest-500869682 None] Terminate volume connection completed successfully.
Sep 16 21:51:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-be2feb61-a86c-446a-afd6-6991b1080ce2 req-483c0fb1-5f86-4c4d-9fe9-af7502c7f017 tempest-TaggedAttachmentsTest-500869682 None] Deleting attachment 3a936500-0e2c-4e86-a5db-a81384b89d0c. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:51:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-59ad5438-63c8-4ca8-ab67-46efbecd73d2 tempest-GroupsTest-328720945 None] Group tempest-Group1-1273654619: creating
Sep 16 21:51:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-59ad5438-63c8-4ca8-ab67-46efbecd73d2 tempest-GroupsTest-328720945 None] Group tempest-Group1-1273654619: created successfully
Sep 16 21:51:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-59ad5438-63c8-4ca8-ab67-46efbecd73d2 tempest-GroupsTest-328720945 None] Create group completed successfully.
Sep 16 21:51:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d2f8752f-6324-4918-b4ab-a1708e2d0b2e tempest-GroupsTest-328720945 None] Group tempest-Group2-1499342717: creating
Sep 16 21:51:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d2f8752f-6324-4918-b4ab-a1708e2d0b2e tempest-GroupsTest-328720945 None] Group tempest-Group2-1499342717: created successfully
Sep 16 21:51:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d2f8752f-6324-4918-b4ab-a1708e2d0b2e tempest-GroupsTest-328720945 None] Create group completed successfully.
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (ae6a5151-1a41-423f-9329-fdf24fd990c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a0c09-b5af-4f7b-8e80-2191329caa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a0c09-b5af-4f7b-8e80-2191329caa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649667192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8fd7fb11-0373-4217-8c4a-c69c73cd5097,host='devstack@QuobyteHD#QuobyteHD',id=afab5af5-49e1-49ac-ad27-c66aa924ef5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:37Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c415e5fc-f291-41c8-9ab8-4bfc434faea2),volume_type_id=c415e5fc-f291-41c8-9ab8-4bfc434faea2)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52663263-2682-461b-8b75-cba20d428613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52663263-2682-461b-8b75-cba20d428613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa90664c-5233-4488-856c-34922df5518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa90664c-5233-4488-856c-34922df5518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afab5af5-49e1-49ac-ad27-c66aa924ef5d', 'volume_name': 'volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adecd099-f021-4d93-b15c-0dce0bdeca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adecd099-f021-4d93-b15c-0dce0bdeca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320c7c83-615b-4be9-be6a-0284e9d75b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Volume afab5af5-49e1-49ac-ad27-c66aa924ef5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d', 'volume_size': 1}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:37 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d 1073741824
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8fd7fb11-0373-4217-8c4a-c69c73cd5097,created_at=2026-09-16T19:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649667192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8fd7fb11-0373-4217-8c4a-c69c73cd5097,host='devstack@QuobyteHD#QuobyteHD',id=afab5af5-49e1-49ac-ad27-c66aa924ef5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:37Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c415e5fc-f291-41c8-9ab8-4bfc434faea2),volume_type_id=c415e5fc-f291-41c8-9ab8-4bfc434faea2)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Creating volume afab5af5-49e1-49ac-ad27-c66aa924ef5d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:51:37 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:51:37 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:51:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:38 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d 1073741824" returned: 0 in 0.553s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:38 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d
Sep 16 21:51:38 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:38 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d" returned: 0 in 0.307s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320c7c83-615b-4be9-be6a-0284e9d75b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1913758b-d22d-4f80-99af-2308fd3b25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:38 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Volume volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d (afab5af5-49e1-49ac-ad27-c66aa924ef5d): created successfully
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1913758b-d22d-4f80-99af-2308fd3b25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (ae6a5151-1a41-423f-9329-fdf24fd990c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bdd43e28-df89-413c-8ab5-42f5f7621958 tempest-GroupsTest-328720945 None] Created volume successfully.
Sep 16 21:51:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Acquiring lock "cinder-quobyte-afab5af5-49e1-49ac-ad27-c66aa924ef5d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-afab5af5-49e1-49ac-ad27-c66aa924ef5d" acquired by "delete_volume" :: waited 0.058s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3c6dd-3cdf-4184-a8a4-ab5a1798adae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:39 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d
Sep 16 21:51:39 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:40 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d" returned: 0 in 0.786s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:40 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d
Sep 16 21:51:40 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:40 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afab5af5-49e1-49ac-ad27-c66aa924ef5d" returned: 0 in 0.575s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-afab5af5-49e1-49ac-ad27-c66aa924ef5d" released by "delete_volume" :: held 1.445s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Created reservations ['e72a0213-04c2-4ecb-9316-1961e72e64b1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:41 devstack cinder-volume[85936]: WARNING cinder.quota [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-466377351 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-466377351, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:51:41 devstack cinder-volume[85936]: WARNING cinder.quota [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-466377351 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-466377351, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Created reservations ['6bca3130-c2e8-4b58-87fe-6e045a8d799d', 'd0609871-b957-4af1-9c5b-e027c5128aa0', '18410f5a-c297-44c7-bdbb-908aea256d5e', '8e551547-8caf-46cd-8242-72db05c443e0'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:41 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:51:41 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:42 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.866s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c7e1a945-c9ca-4a77-8ab5-844d535e151a tempest-GroupsTest-328720945 None] Delete group completed successfully.
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Created reservations ['58d65f8f-e105-4003-aade-70af6e49b9bd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:43 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:51:43 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:43 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.312s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:43 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-405e5a8d-ff0b-41d5-aa30-cd09efbf3590 tempest-GroupsTest-328720945 None] Delete group completed successfully.
Sep 16 21:51:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9a49d063-d01c-4202-a0b2-ce300981d822 tempest-GroupsTest-328720945 None] Group tempest-GroupsTest-Group-883930810: creating
Sep 16 21:51:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9a49d063-d01c-4202-a0b2-ce300981d822 tempest-GroupsTest-328720945 None] Group tempest-GroupsTest-Group-883930810: created successfully
Sep 16 21:51:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9a49d063-d01c-4202-a0b2-ce300981d822 tempest-GroupsTest-328720945 None] Create group completed successfully.
Sep 16 21:51:46 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (634ee86f-7af1-4fd2-80b4-c5d48099e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069d77ea-5ee4-4684-8cbd-d7d43925b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069d77ea-5ee4-4684-8cbd-d7d43925b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285217089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,host='devstack@QuobyteHD#QuobyteHD',id=275084d9-d375-4813-a2d6-1aa115ef83e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:47Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1221a4-2633-4f9f-9bb6-6b5cc866c19d),volume_type_id=0c1221a4-2633-4f9f-9bb6-6b5cc866c19d)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2919e676-9c3b-453f-a6aa-b0e2de771c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2919e676-9c3b-453f-a6aa-b0e2de771c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4ab1ac-c014-40c1-a516-91c307dc404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4ab1ac-c014-40c1-a516-91c307dc404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275084d9-d375-4813-a2d6-1aa115ef83e8', 'volume_name': 'volume-275084d9-d375-4813-a2d6-1aa115ef83e8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6680a4b-3653-4294-a6fb-c88b0516c434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6680a4b-3653-4294-a6fb-c88b0516c434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f85e71-492c-417a-a4ad-e78efca4bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:47 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Volume 275084d9-d375-4813-a2d6-1aa115ef83e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275084d9-d375-4813-a2d6-1aa115ef83e8', 'volume_size': 1}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,created_at=2026-09-16T19:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-285217089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,host='devstack@QuobyteHD#QuobyteHD',id=275084d9-d375-4813-a2d6-1aa115ef83e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:47Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1221a4-2633-4f9f-9bb6-6b5cc866c19d),volume_type_id=0c1221a4-2633-4f9f-9bb6-6b5cc866c19d)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Creating volume 275084d9-d375-4813-a2d6-1aa115ef83e8 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:51:47 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:47 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 1073741824
Sep 16 21:51:47 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:47 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 1073741824" returned: 0 in 0.686s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:47 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8
Sep 16 21:51:47 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:48 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8" returned: 0 in 0.509s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f85e71-492c-417a-a4ad-e78efca4bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275084d9-d375-4813-a2d6-1aa115ef83e8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c40f30-5b3b-4e98-9739-1cc5670340df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:48 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Volume volume-275084d9-d375-4813-a2d6-1aa115ef83e8 (275084d9-d375-4813-a2d6-1aa115ef83e8): created successfully
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c40f30-5b3b-4e98-9739-1cc5670340df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (634ee86f-7af1-4fd2-80b4-c5d48099e722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b13fba77-cbc5-493d-a7ad-ad24345fbb4c tempest-GroupsTest-328720945 None] Created volume successfully.
Sep 16 21:51:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "cinder-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "cinder-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "cinder-quobyte-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "cinder-quobyte-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855da5f-9081-48d1-bea1-3f2b336d2cb9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (2f0e5f1c-246f-4530-998d-7ff59bd58ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d44009c-d2b0-4d93-9b2d-83de4ac35e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d44009c-d2b0-4d93-9b2d-83de4ac35e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988342330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,host='devstack@QuobyteHD#QuobyteHD',id=dce0c49f-32a8-473f-8e55-118d0c4c24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:51Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1221a4-2633-4f9f-9bb6-6b5cc866c19d),volume_type_id=0c1221a4-2633-4f9f-9bb6-6b5cc866c19d)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed01e78-f0aa-490a-9dce-cdf0ce2a5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed01e78-f0aa-490a-9dce-cdf0ce2a5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19b535-3145-46ed-9824-65e8096123ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19b535-3145-46ed-9824-65e8096123ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce0c49f-32a8-473f-8e55-118d0c4c24d3', 'volume_name': 'volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8edbce-715b-4004-a905-7515ecae8b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8edbce-715b-4004-a905-7515ecae8b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0f30ac-f7c9-4e1f-8d44-56a820648bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Volume dce0c49f-32a8-473f-8e55-118d0c4c24d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3', 'volume_size': 1}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,created_at=2026-09-16T19:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988342330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1397a3e-9bc8-4633-843b-d84ea9acffec,host='devstack@QuobyteHD#QuobyteHD',id=dce0c49f-32a8-473f-8e55-118d0c4c24d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509268d8287b4f439ef949289242828b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:51:51Z,use_quota=True,user_id='1ab474fd0d354743b2f732bb456d2897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c1221a4-2633-4f9f-9bb6-6b5cc866c19d),volume_type_id=0c1221a4-2633-4f9f-9bb6-6b5cc866c19d)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Creating volume dce0c49f-32a8-473f-8e55-118d0c4c24d3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:51:51 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:51 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1
Sep 16 21:51:51 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:51 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 1073741824
Sep 16 21:51:51 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:51 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" returned: 0 in 0.727s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:51 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1
Sep 16 21:51:51 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:52 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" returned: 0 in 0.416s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "cinder-quobyte-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1" released by "delete_volume" :: held 1.232s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:52 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 1073741824" returned: 0 in 0.879s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Created reservations ['fbdffc82-660d-4c87-9ace-54c23739ea3c', '83fb2e36-3123-4b94-92a0-b9eddc78324a', '983da72d-bf08-47d1-bdaa-a772733bf6b0', '20bcfa8c-4f41-4223-b59d-0d97454fc17d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:51:52 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3
Sep 16 21:51:52 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:52 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:51:52 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:53 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3" returned: 0 in 0.626s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:51:53 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0f30ac-f7c9-4e1f-8d44-56a820648bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e92954-6336-4230-a7dd-e0daa1c43355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.564s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:51:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Deleted volume successfully.
Sep 16 21:51:53 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Volume volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 (dce0c49f-32a8-473f-8e55-118d0c4c24d3): created successfully
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e92954-6336-4230-a7dd-e0daa1c43355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Flow 'volume_create_manager' (2f0e5f1c-246f-4530-998d-7ff59bd58ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:51:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5d2337fb-f0a8-4ab6-9595-2aeb87c1d89a tempest-GroupsTest-328720945 None] Created volume successfully.
Sep 16 21:51:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2848b8da-8435-4e77-9102-65cc86fa2087 tempest-TaggedAttachmentsTest-500869682 None] Lock "cinder-8277424a-265b-4ca3-9bbe-8f8c1f54a5c1-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-edf98989-8ad4-467d-b97f-edc7c4ee2f56 tempest-GroupsTest-328720945 None] Update group completed successfully.
Sep 16 21:51:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-12520efa-17a2-4acf-b7e2-6029ee78842b tempest-GroupsTest-328720945 None] Update group completed successfully.
Sep 16 21:51:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Acquiring lock "cinder-quobyte-275084d9-d375-4813-a2d6-1aa115ef83e8" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-275084d9-d375-4813-a2d6-1aa115ef83e8" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eeb80c-118b-4750-a686-78dec523e7e6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:58 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8
Sep 16 21:51:58 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:58 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:58 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8
Sep 16 21:51:58 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:58 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-275084d9-d375-4813-a2d6-1aa115ef83e8" returned: 0 in 0.296s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-275084d9-d375-4813-a2d6-1aa115ef83e8" released by "delete_volume" :: held 0.762s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Acquiring lock "cinder-quobyte-dce0c49f-32a8-473f-8e55-118d0c4c24d3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-dce0c49f-32a8-473f-8e55-118d0c4c24d3" acquired by "delete_volume" :: waited 0.040s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a8e46-db41-4e67-ae43-c1d34ad8c9c1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:51:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:58 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3
Sep 16 21:51:58 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:59 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3" returned: 0 in 0.799s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:51:59 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3
Sep 16 21:51:59 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:51:59 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Sep 16 21:51:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-dce0c49f-32a8-473f-8e55-118d0c4c24d3" returned: 0 in 0.403s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:51:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "cinder-quobyte-dce0c49f-32a8-473f-8e55-118d0c4c24d3" released by "delete_volume" :: held 1.295s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Created reservations ['9b8d7558-4460-47bd-aa21-735a54fcfbcd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:00 devstack cinder-volume[85936]: WARNING cinder.quota [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1394314762 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1394314762, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:52:00 devstack cinder-volume[85936]: WARNING cinder.quota [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1394314762 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1394314762, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Created reservations ['68313f2a-a8b7-4209-9f18-9412a5ab6f4a', '0ec0924e-7c09-4170-b4c3-a766eba586b4', 'f8d77562-e202-477c-8231-8191c84af79a', '83dcf271-4f9b-4969-93db-4423e27e8eb3'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Created reservations ['61a13dcc-199e-44f3-a083-d6d13673ba33', '147ecc78-8f21-42fd-9a3a-d3d7851c9627', '05ffbecd-cff9-4541-b2d8-5e1d5539f9fe', '44357f28-3d78-49a9-bfa1-e5769836536a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:00 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:00 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:01 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.559s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:01 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-67c5e7af-6456-4728-ad0e-97b68733755a tempest-GroupsTest-328720945 None] Delete group completed successfully.
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Flow 'volume_create_manager' (fcdb57de-edeb-432b-89c3-c7074c0aeb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05757b0-21bb-4e9c-bf70-563e7bfe25e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05757b0-21bb-4e9c-bf70-563e7bfe25e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-653858580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d8c39f-1f75-4dec-98a3-4f49808d3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a29ace97ddd47c68700cec550d911c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:09Z,use_quota=True,user_id='d2136625363a41aca1101c9d93297500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1cc0c0-4364-4033-ab54-c8d1dc6a68c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c1cc0c0-4364-4033-ab54-c8d1dc6a68c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842443f8-20bf-468d-8f26-6da361e9a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842443f8-20bf-468d-8f26-6da361e9a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3d8c39f-1f75-4dec-98a3-4f49808d3d49', 'volume_name': 'volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923df7a2-266c-4e5e-8292-2da0af72aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923df7a2-266c-4e5e-8292-2da0af72aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c073ae3-794f-46e1-925c-b4df5663a1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Volume d3d8c39f-1f75-4dec-98a3-4f49808d3d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49', 'volume_size': 1}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-653858580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3d8c39f-1f75-4dec-98a3-4f49808d3d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a29ace97ddd47c68700cec550d911c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:09Z,use_quota=True,user_id='d2136625363a41aca1101c9d93297500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Creating volume d3d8c39f-1f75-4dec-98a3-4f49808d3d49 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:09 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:09 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 1073741824
Sep 16 21:52:09 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:10 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 1073741824" returned: 0 in 1.016s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:10 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=69,cinder:SELECT=82,cinder:DELETE=6,cinder:INSERT=16 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:52:10 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=61,cinder:INSERT=16,cinder:UPDATE=80,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:52:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:10 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49
Sep 16 21:52:10 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:11 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" returned: 0 in 0.645s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c073ae3-794f-46e1-925c-b4df5663a1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2826ba4b-0624-4457-a881-b532c347c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Volume volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 (d3d8c39f-1f75-4dec-98a3-4f49808d3d49): created successfully
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2826ba4b-0624-4457-a881-b532c347c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Flow 'volume_create_manager' (fcdb57de-edeb-432b-89c3-c7074c0aeb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-17cb479b-7aa7-4989-932f-a858d03c1746 tempest-ServersNegativeTestJSON-17757348 None] Created volume successfully.
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Flow 'volume_create_manager' (6c26b094-91ce-426a-829b-ffaaf505088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b744ef3f-5fd5-4f1b-bea3-dae6368866f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b744ef3f-5fd5-4f1b-bea3-dae6368866f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462048020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c07fcc-8882-4eb4-aea1-456b514e0131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a29ace97ddd47c68700cec550d911c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:14Z,use_quota=True,user_id='d2136625363a41aca1101c9d93297500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd2ff65-e697-443f-8d2f-25d409610529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd2ff65-e697-443f-8d2f-25d409610529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f03ab2-5d98-4d82-ad09-e1074e016b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f03ab2-5d98-4d82-ad09-e1074e016b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c07fcc-8882-4eb4-aea1-456b514e0131', 'volume_name': 'volume-b6c07fcc-8882-4eb4-aea1-456b514e0131', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b4eea-8d84-4818-b449-56dff9551896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b4eea-8d84-4818-b449-56dff9551896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d055494a-e505-4f88-8d49-4aecbc75b05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Volume b6c07fcc-8882-4eb4-aea1-456b514e0131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c07fcc-8882-4eb4-aea1-456b514e0131', 'volume_size': 1}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462048020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c07fcc-8882-4eb4-aea1-456b514e0131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a29ace97ddd47c68700cec550d911c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:14Z,use_quota=True,user_id='d2136625363a41aca1101c9d93297500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Creating volume b6c07fcc-8882-4eb4-aea1-456b514e0131 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:13 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:13 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 1073741824
Sep 16 21:52:13 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:14 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 1073741824" returned: 0 in 0.926s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:14 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131
Sep 16 21:52:14 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Flow 'volume_create_manager' (6d74889b-5654-4d4d-aeb0-830a168913d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af200cb9-3f52-4ecb-8ac2-42fb16bc2dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af200cb9-3f52-4ecb-8ac2-42fb16bc2dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-180370072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac644fd-5b0a-446d-95d1-6b903d3b49cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1ba8f82efc4a6197089e4324f16472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:15Z,use_quota=True,user_id='6332261e90dc478ead275206d08cd4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7042f6e-f879-402a-b78d-d0ee44c2fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7042f6e-f879-402a-b78d-d0ee44c2fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113383e1-db22-4575-8460-69657a8b4232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113383e1-db22-4575-8460-69657a8b4232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac644fd-5b0a-446d-95d1-6b903d3b49cd', 'volume_name': 'volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef2e1c-42ee-43dc-b77d-defadd76ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fef2e1c-42ee-43dc-b77d-defadd76ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710fc63b-f954-4b20-8450-c076542f9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Volume 1ac644fd-5b0a-446d-95d1-6b903d3b49cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd', 'volume_size': 1}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:15 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-180370072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac644fd-5b0a-446d-95d1-6b903d3b49cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1ba8f82efc4a6197089e4324f16472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:15Z,use_quota=True,user_id='6332261e90dc478ead275206d08cd4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Creating volume 1ac644fd-5b0a-446d-95d1-6b903d3b49cd {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d055494a-e505-4f88-8d49-4aecbc75b05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c07fcc-8882-4eb4-aea1-456b514e0131', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c75398-91e5-437a-acc7-b0cc27636511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:15 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd 1073741824
Sep 16 21:52:15 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Volume volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 (b6c07fcc-8882-4eb4-aea1-456b514e0131): created successfully
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c75398-91e5-437a-acc7-b0cc27636511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Flow 'volume_create_manager' (6c26b094-91ce-426a-829b-ffaaf505088e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3f9efc04-66eb-42e7-8a12-8bec6c117a75 tempest-ServersNegativeTestJSON-17757348 None] Created volume successfully.
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b89cc275-c0ee-4f7d-b83f-cf7446f9fa38 tempest-GroupsV320Test-474833283 None] Group tempest-GroupsV320Test-Group-1700488053: creating
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b89cc275-c0ee-4f7d-b83f-cf7446f9fa38 tempest-GroupsV320Test-474833283 None] Group tempest-GroupsV320Test-Group-1700488053: created successfully
Sep 16 21:52:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b89cc275-c0ee-4f7d-b83f-cf7446f9fa38 tempest-GroupsV320Test-474833283 None] Create group completed successfully.
Sep 16 21:52:15 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd 1073741824" returned: 0 in 0.643s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:15 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd
Sep 16 21:52:15 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:16 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710fc63b-f954-4b20-8450-c076542f9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c9b767-c10b-467e-adb9-aa428ad757ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Volume volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd (1ac644fd-5b0a-446d-95d1-6b903d3b49cd): created successfully
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c9b767-c10b-467e-adb9-aa428ad757ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Flow 'volume_create_manager' (6d74889b-5654-4d4d-aeb0-830a168913d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c3ed5025-2be9-43bc-a757-8aef7d2c8b06 tempest-VolumesAdminNegativeTest-505562352 None] Created volume successfully.
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "cinder-b6c07fcc-8882-4eb4-aea1-456b514e0131-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-b6c07fcc-8882-4eb4-aea1-456b514e0131-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "cinder-quobyte-b6c07fcc-8882-4eb4-aea1-456b514e0131" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-quobyte-b6c07fcc-8882-4eb4-aea1-456b514e0131" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a1969-daee-425c-8940-414d149418d4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:52:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:16 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131
Sep 16 21:52:16 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:17 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131" returned: 0 in 0.608s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:17 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131
Sep 16 21:52:17 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:17 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b6c07fcc-8882-4eb4-aea1-456b514e0131" returned: 0 in 0.453s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-quobyte-b6c07fcc-8882-4eb4-aea1-456b514e0131" released by "delete_volume" :: held 1.138s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Created reservations ['8c500cad-52be-4d27-bf0b-88ee26adf2c5'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Created reservations ['d8213551-e5e3-4e2d-aa26-4273f75e4b32', 'c6778a04-ebfa-4646-a59f-0dceb909b518', '46f14fdd-e229-40c4-9ed9-8d182e7eec61', '31ba90e3-9bd5-47a0-857f-f62f0ef7ed59'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:17 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:17 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Acquiring lock "cinder-1ac644fd-5b0a-446d-95d1-6b903d3b49cd-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "cinder-1ac644fd-5b0a-446d-95d1-6b903d3b49cd-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Acquiring lock "cinder-quobyte-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:18 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:18 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "cinder-quobyte-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" acquired by "delete_volume" :: waited 0.068s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:18 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c0766d75-18f2-4d51-93a9-c5fd64a50824 tempest-GroupsV320Test-474833283 None] Delete group completed successfully.
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c18d3-d387-472e-9787-2699be70f8be]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:18 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd
Sep 16 21:52:18 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:18 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.399s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Deleted volume successfully.
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e123696c-9cba-4445-888d-6d7b1d4f2e25 tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-b6c07fcc-8882-4eb4-aea1-456b514e0131-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:18 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" returned: 0 in 0.468s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:18 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd
Sep 16 21:52:18 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "cinder-d3d8c39f-1f75-4dec-98a3-4f49808d3d49-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-d3d8c39f-1f75-4dec-98a3-4f49808d3d49-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "cinder-quobyte-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-quobyte-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6e6fc-2950-4163-80f1-e534aeb70a07]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:19 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49
Sep 16 21:52:19 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:19 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" returned: 0 in 0.532s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "cinder-quobyte-1ac644fd-5b0a-446d-95d1-6b903d3b49cd" released by "delete_volume" :: held 1.071s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Created reservations ['a920e0ed-291f-4699-9726-08052bf6ac1f', '6bf3213b-48ba-44b2-845e-091f7c20af35', '7fb417c1-2a03-4ba1-a8e0-a738df3840e6', 'bca7b3b5-e925-4176-9be0-5d69f4543b27'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:19 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:19 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:19 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" returned: 0 in 0.705s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:19 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49
Sep 16 21:52:19 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:19 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.372s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Deleted volume successfully.
Sep 16 21:52:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d670a3dc-8514-4055-8177-9730ec2827f9 tempest-VolumesAdminNegativeTest-505562352 None] Lock "cinder-1ac644fd-5b0a-446d-95d1-6b903d3b49cd-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:20 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" returned: 0 in 0.625s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-quobyte-d3d8c39f-1f75-4dec-98a3-4f49808d3d49" released by "delete_volume" :: held 1.388s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Created reservations ['cc84bff2-6e3c-41d9-ae5c-62c0fad02673', '3757f35c-17b9-4556-9208-4ee7d65686f1', 'ae7e4ac6-a3ab-417f-8e28-368d29f7e910', '9e3322ba-c5a0-4384-a70d-44db25c44b26'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:20 devstack sudo[89246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:20 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:21 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.388s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Deleted volume successfully.
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-614ca154-beaf-472d-8b0c-909797fbb44a tempest-ServersNegativeTestJSON-17757348 None] Lock "cinder-d3d8c39f-1f75-4dec-98a3-4f49808d3d49-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:21 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:21 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:22 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.468s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:52:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 8 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:52:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:52:30 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=35,cinder:DELETE=3,cinder:SELECT=26,cinder:INSERT=11 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:52:31 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Flow 'volume_create_manager' (e2381af6-f99f-48ca-8b77-cad6c01530c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e1ae85-0f8e-4bab-9cbd-9c4deced7796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e1ae85-0f8e-4bab-9cbd-9c4deced7796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1332571676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe72e12e-c480-4a7b-98be-36b6f157929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16baedb210c6474a824c409edc4ea787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:51Z,use_quota=True,user_id='1f2176b03a0a41078f7ba1ae4fa4e644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae58eee6-215a-40c4-bd03-21bd4e13b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae58eee6-215a-40c4-bd03-21bd4e13b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b49655-9eb5-4a0a-ba29-fee40496b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b49655-9eb5-4a0a-ba29-fee40496b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe72e12e-c480-4a7b-98be-36b6f157929d', 'volume_name': 'volume-fe72e12e-c480-4a7b-98be-36b6f157929d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26030ca0-db67-46af-b51f-aff70549aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26030ca0-db67-46af-b51f-aff70549aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ff72b-dd60-4b25-9d91-7959246e2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Volume fe72e12e-c480-4a7b-98be-36b6f157929d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe72e12e-c480-4a7b-98be-36b6f157929d', 'volume_size': 1}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1332571676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe72e12e-c480-4a7b-98be-36b6f157929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16baedb210c6474a824c409edc4ea787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:51Z,use_quota=True,user_id='1f2176b03a0a41078f7ba1ae4fa4e644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Creating volume fe72e12e-c480-4a7b-98be-36b6f157929d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:51 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:51 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d 1073741824
Sep 16 21:52:51 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Flow 'volume_create_manager' (71d53bbe-8749-46d1-8ca1-aefc66e478ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cf6d99-8ddd-49dd-92ee-7d936116b3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cf6d99-8ddd-49dd-92ee-7d936116b3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2127013648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d636446-9ce9-4435-9366-a5306417c071,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ba2bd3cb149f9842707615465049b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:52Z,use_quota=True,user_id='f7dc0d6cebea4e5bbd11f3043b7c2071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646a3d6e-a2da-4904-a74b-2faa10e03615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646a3d6e-a2da-4904-a74b-2faa10e03615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf081cf-e659-47b0-b09f-6a87ccba30c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf081cf-e659-47b0-b09f-6a87ccba30c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d636446-9ce9-4435-9366-a5306417c071', 'volume_name': 'volume-9d636446-9ce9-4435-9366-a5306417c071', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7350028-6ede-43e6-a2cf-cac0dd132c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7350028-6ede-43e6-a2cf-cac0dd132c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b02364-ac3a-4c2c-a300-f46d12f4af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Volume 9d636446-9ce9-4435-9366-a5306417c071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d636446-9ce9-4435-9366-a5306417c071', 'volume_size': 1}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:52 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d 1073741824" returned: 0 in 0.723s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:52 devstack sudo[89464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d
Sep 16 21:52:52 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:52 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2127013648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d636446-9ce9-4435-9366-a5306417c071,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cf0ba2bd3cb149f9842707615465049b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:52Z,use_quota=True,user_id='f7dc0d6cebea4e5bbd11f3043b7c2071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Creating volume 9d636446-9ce9-4435-9366-a5306417c071 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:52 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ff72b-dd60-4b25-9d91-7959246e2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe72e12e-c480-4a7b-98be-36b6f157929d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66123164-6c5b-4026-950b-bc6ebb5a1a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:52 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 1073741824
Sep 16 21:52:53 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:53 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Volume volume-fe72e12e-c480-4a7b-98be-36b6f157929d (fe72e12e-c480-4a7b-98be-36b6f157929d): created successfully
Sep 16 21:52:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66123164-6c5b-4026-950b-bc6ebb5a1a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Flow 'volume_create_manager' (e2381af6-f99f-48ca-8b77-cad6c01530c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6cef4722-7845-44c1-942f-3d3c9f4fba45 tempest-VolumesTransfersV357Test-100632167 None] Created volume successfully.
Sep 16 21:52:53 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 1073741824" returned: 0 in 0.766s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:53 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071
Sep 16 21:52:53 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:54 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071" returned: 0 in 0.521s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b02364-ac3a-4c2c-a300-f46d12f4af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d636446-9ce9-4435-9366-a5306417c071', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d3436f-f6a0-4655-93c4-36e6f5456ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:54 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Volume volume-9d636446-9ce9-4435-9366-a5306417c071 (9d636446-9ce9-4435-9366-a5306417c071): created successfully
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d3436f-f6a0-4655-93c4-36e6f5456ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Flow 'volume_create_manager' (71d53bbe-8749-46d1-8ca1-aefc66e478ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-c3b51fa8-8af9-4452-8701-2afaef16c8f1 req-c16337af-0d3f-4676-91b2-a9d75e1ede7a tempest-VolumesGetTestJSON-1566728431 None] Created volume successfully.
Sep 16 21:52:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5c9db909-e8c2-4d80-81ee-dcb8f44016ae tempest-VolumesTransfersV357Test-929728059 None] Transfer volume completed successfully.
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Acquiring lock "cinder-9d636446-9ce9-4435-9366-a5306417c071-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "cinder-9d636446-9ce9-4435-9366-a5306417c071-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Acquiring lock "cinder-quobyte-9d636446-9ce9-4435-9366-a5306417c071" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "cinder-quobyte-9d636446-9ce9-4435-9366-a5306417c071" acquired by "delete_volume" :: waited 0.069s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be2d68-b5b1-4410-a22f-e6b2dd04cb42]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:52:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:56 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071
Sep 16 21:52:56 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "cinder-fe72e12e-c480-4a7b-98be-36b6f157929d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-fe72e12e-c480-4a7b-98be-36b6f157929d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "cinder-quobyte-fe72e12e-c480-4a7b-98be-36b6f157929d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:52:56 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071" returned: 0 in 0.717s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-quobyte-fe72e12e-c480-4a7b-98be-36b6f157929d" acquired by "delete_volume" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:52:56 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071
Sep 16 21:52:56 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617f486-4b19-406d-92b9-cf85a3c67847]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:56 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d
Sep 16 21:52:56 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:56 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9d636446-9ce9-4435-9366-a5306417c071" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "cinder-quobyte-9d636446-9ce9-4435-9366-a5306417c071" released by "delete_volume" :: held 1.217s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:56 devstack cinder-volume[85936]: DEBUG cinder.quota [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Created reservations ['d5ed665e-cbdf-4519-82d0-03645efb79d9', '7832b8b0-4e82-435f-911e-5120adcdf3d5', '1aaa8856-214a-4dad-aa2a-80bfcc1bbb32', '03ca2ed6-edbf-442f-a896-26b2e24ad849'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:57 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d" returned: 0 in 0.482s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:57 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d
Sep 16 21:52:57 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:57 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:57 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:57 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:57 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe72e12e-c480-4a7b-98be-36b6f157929d" returned: 0 in 0.312s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.manager [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-quobyte-fe72e12e-c480-4a7b-98be-36b6f157929d" released by "delete_volume" :: held 0.869s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Deleted volume successfully.
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-3cb14b26-0ebf-4b92-86c1-73896b9d10c6 req-4e21b64f-e51d-4357-b467-31e388a2d196 tempest-VolumesGetTestJSON-1566728431 None] Lock "cinder-9d636446-9ce9-4435-9366-a5306417c071-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Created reservations ['66e276da-e5a3-4cdc-9521-b3786ebd784d', '3e50c233-d7ea-45a7-a58d-e09d0c1210bf', '96ab24b6-8bf8-480c-8e50-9c5472cdc714', 'c805fcf2-e8b2-4b5c-8e63-c29ff8bfce65'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:57 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:52:57 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:57 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.353s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:52:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Deleted volume successfully.
Sep 16 21:52:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-648941f4-d25e-47a7-8235-ac6a22191c62 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-fe72e12e-c480-4a7b-98be-36b6f157929d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Flow 'volume_create_manager' (bad4f667-7399-429b-8697-169f7e7be172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e9f69-0480-4dda-a85d-8c7abfeb1b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e9f69-0480-4dda-a85d-8c7abfeb1b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1585600002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491a860d-43a8-4e92-ad83-1b96af6441fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16baedb210c6474a824c409edc4ea787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:58Z,use_quota=True,user_id='1f2176b03a0a41078f7ba1ae4fa4e644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf19aa-dce1-4a1c-bd8a-b8c0479c0a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cf19aa-dce1-4a1c-bd8a-b8c0479c0a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf968c35-d471-42cd-9e05-b16702d32fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf968c35-d471-42cd-9e05-b16702d32fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491a860d-43a8-4e92-ad83-1b96af6441fb', 'volume_name': 'volume-491a860d-43a8-4e92-ad83-1b96af6441fb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0bf7c5-b4ec-4f72-a0eb-d4344a6b9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0bf7c5-b4ec-4f72-a0eb-d4344a6b9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5f397c-04df-4923-b04f-e6b7ca0e27e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Volume 491a860d-43a8-4e92-ad83-1b96af6441fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491a860d-43a8-4e92-ad83-1b96af6441fb', 'volume_size': 1}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1585600002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491a860d-43a8-4e92-ad83-1b96af6441fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16baedb210c6474a824c409edc4ea787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:52:58Z,use_quota=True,user_id='1f2176b03a0a41078f7ba1ae4fa4e644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Creating volume 491a860d-43a8-4e92-ad83-1b96af6441fb {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:52:58 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:52:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:58 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb 1073741824
Sep 16 21:52:58 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:59 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb 1073741824" returned: 0 in 0.523s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:52:59 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb
Sep 16 21:52:59 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:52:59 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb" returned: 0 in 0.352s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5f397c-04df-4923-b04f-e6b7ca0e27e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491a860d-43a8-4e92-ad83-1b96af6441fb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1500f1-419d-4583-8b16-e51ad369ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:52:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Volume volume-491a860d-43a8-4e92-ad83-1b96af6441fb (491a860d-43a8-4e92-ad83-1b96af6441fb): created successfully
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1500f1-419d-4583-8b16-e51ad369ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:52:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Flow 'volume_create_manager' (bad4f667-7399-429b-8697-169f7e7be172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:52:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-316af32a-4ff5-4814-beab-bba47ac1bab3 tempest-VolumesTransfersV357Test-100632167 None] Created volume successfully.
Sep 16 21:53:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "cinder-491a860d-43a8-4e92-ad83-1b96af6441fb-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-491a860d-43a8-4e92-ad83-1b96af6441fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "cinder-quobyte-491a860d-43a8-4e92-ad83-1b96af6441fb" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-quobyte-491a860d-43a8-4e92-ad83-1b96af6441fb" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[710a4037-c280-4ea2-bb56-fe89ae055144]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:01 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb
Sep 16 21:53:01 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:01 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb" returned: 0 in 0.442s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:01 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb
Sep 16 21:53:01 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:01 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-491a860d-43a8-4e92-ad83-1b96af6441fb" returned: 0 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-quobyte-491a860d-43a8-4e92-ad83-1b96af6441fb" released by "delete_volume" :: held 0.813s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:01 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Created reservations ['9f7871f9-8b58-489e-ae0f-407b0cc35b7b', '981ac529-f1a2-4250-b330-905188850a30', '42d43b40-7301-4379-a961-32bc6525667f', '0770eb64-d514-4c38-8b3c-dcaa5a6709bd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:02 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:02 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:02 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.320s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Deleted volume successfully.
Sep 16 21:53:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b621515-3f4d-4173-affe-2ceeb932d003 tempest-VolumesTransfersV357Test-254857817 None] Lock "cinder-491a860d-43a8-4e92-ad83-1b96af6441fb-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bae2da47-a690-4628-b8f2-a4566df83fdc tempest-BackendsCapabilitiesAdminTestsJSON-1692274104 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85936) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 21:53:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f128c1d2-e720-4991-a349-535e74540108 tempest-BackendsCapabilitiesAdminTestsJSON-1692274104 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85936) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=36,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:INSERT=9,cinder:DELETE=4 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Flow 'volume_create_manager' (29ec22aa-3f83-4dde-b23e-729c5ae04237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c53d12e-6127-42ab-8936-e89095035efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bc5571b3-9c0f-4c95-bc04-52b50d64d2c9 tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1150425803: creating
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c53d12e-6127-42ab-8936-e89095035efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2075230996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09d8c74-f74e-49f3-aa60-d80bb38191cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f117fa59804381814b61d8d8b797af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:12Z,use_quota=True,user_id='a3b69f1ef5574101b531b47015be3a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84822115-2cc3-4f90-9215-a47f9e1151b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84822115-2cc3-4f90-9215-a47f9e1151b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc52b69-5ddf-46ae-a562-0f9a02f19774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc52b69-5ddf-46ae-a562-0f9a02f19774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09d8c74-f74e-49f3-aa60-d80bb38191cf', 'volume_name': 'volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf', 'volume_size': 2}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e3e548-e6f6-4e1a-b36d-ddb97234a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e3e548-e6f6-4e1a-b36d-ddb97234a574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24de3758-eedb-4f8d-9a04-1f35a8f9fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Volume c09d8c74-f74e-49f3-aa60-d80bb38191cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf', 'volume_size': 2}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2075230996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09d8c74-f74e-49f3-aa60-d80bb38191cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f117fa59804381814b61d8d8b797af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:12Z,use_quota=True,user_id='a3b69f1ef5574101b531b47015be3a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Creating volume c09d8c74-f74e-49f3-aa60-d80bb38191cf {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:12 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf 2147483648 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:12 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf 2147483648
Sep 16 21:53:12 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bc5571b3-9c0f-4c95-bc04-52b50d64d2c9 tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1150425803: created successfully
Sep 16 21:53:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bc5571b3-9c0f-4c95-bc04-52b50d64d2c9 tempest-GroupSnapshotsTest-128892063 None] Create group completed successfully.
Sep 16 21:53:13 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf 2147483648" returned: 0 in 0.475s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:13 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf
Sep 16 21:53:13 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:13 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24de3758-eedb-4f8d-9a04-1f35a8f9fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf', 'volume_size': 2}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e875a04e-537c-42d4-a031-9d6f5962f455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Volume volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf (c09d8c74-f74e-49f3-aa60-d80bb38191cf): created successfully
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e875a04e-537c-42d4-a031-9d6f5962f455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Flow 'volume_create_manager' (29ec22aa-3f83-4dde-b23e-729c5ae04237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bf13c91b-dcfd-4e66-b969-461457b3d0db tempest-VolumesCloneNegativeTest-766895246 None] Created volume successfully.
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (00c37ae3-d2f8-4de9-9595-bb46ee0668cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cda8a2-8489-4ea9-829a-94d080f108a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cda8a2-8489-4ea9-829a-94d080f108a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891194047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ff33e3f-4c9d-4c7b-81c0-b7a3adf88e86,host='devstack@QuobyteHD#QuobyteHD',id=392b759d-413b-4e88-8bc0-182997fdf004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:14Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dd94d09-c126-47a7-8c97-74eadf3cedec),volume_type_id=2dd94d09-c126-47a7-8c97-74eadf3cedec)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d014d6-9f30-473e-97cd-befbcfa3c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d014d6-9f30-473e-97cd-befbcfa3c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9540d415-c86d-493a-876a-65721bcc3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9540d415-c86d-493a-876a-65721bcc3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392b759d-413b-4e88-8bc0-182997fdf004', 'volume_name': 'volume-392b759d-413b-4e88-8bc0-182997fdf004', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a17e785-3df0-4b44-848a-f395e5016bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a17e785-3df0-4b44-848a-f395e5016bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0971adb4-2622-46a6-abc8-bb62e69940f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Volume 392b759d-413b-4e88-8bc0-182997fdf004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392b759d-413b-4e88-8bc0-182997fdf004', 'volume_size': 1}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9ff33e3f-4c9d-4c7b-81c0-b7a3adf88e86,created_at=2026-09-16T19:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1891194047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ff33e3f-4c9d-4c7b-81c0-b7a3adf88e86,host='devstack@QuobyteHD#QuobyteHD',id=392b759d-413b-4e88-8bc0-182997fdf004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:14Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2dd94d09-c126-47a7-8c97-74eadf3cedec),volume_type_id=2dd94d09-c126-47a7-8c97-74eadf3cedec)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Creating volume 392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:14 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 1073741824
Sep 16 21:53:14 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Flow 'volume_create_manager' (5a5498ca-94c1-4988-aba1-d6c847bbb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544d2a72-2b6a-4bc6-8d72-588c45e320f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544d2a72-2b6a-4bc6-8d72-588c45e320f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-130364372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ddcaf3-aa7a-4158-a78a-a5ffdc84c555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f9a214855345f9895b5a5ed4bb538a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:15Z,use_quota=True,user_id='fd9cedce49e844958277df9a3685c583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efeded3-6c6e-48fb-be39-86bc81c04134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efeded3-6c6e-48fb-be39-86bc81c04134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fb8a86-6c83-4ca5-9d76-e99c48c40347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fb8a86-6c83-4ca5-9d76-e99c48c40347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'volume_name': 'volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc34b80-42fe-4280-8a09-14ceef297cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc34b80-42fe-4280-8a09-14ceef297cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79b0265-c46c-445f-b59a-3395a786a666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Volume 00ddcaf3-aa7a-4158-a78a-a5ffdc84c555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'volume_size': 1}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Acquiring lock "cinder-c09d8c74-f74e-49f3-aa60-d80bb38191cf-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "cinder-c09d8c74-f74e-49f3-aa60-d80bb38191cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Acquiring lock "cinder-quobyte-c09d8c74-f74e-49f3-aa60-d80bb38191cf" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "cinder-quobyte-c09d8c74-f74e-49f3-aa60-d80bb38191cf" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827b78a-df97-45d5-a349-5494bf377389]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:15 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 1073741824" returned: 0 in 0.842s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:15 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf
Sep 16 21:53:15 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:15 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:15 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:15 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:15 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:15 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-130364372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ddcaf3-aa7a-4158-a78a-a5ffdc84c555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f9a214855345f9895b5a5ed4bb538a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:15Z,use_quota=True,user_id='fd9cedce49e844958277df9a3685c583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Creating volume 00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:15 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:15 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:15 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 1073741824
Sep 16 21:53:15 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0971adb4-2622-46a6-abc8-bb62e69940f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392b759d-413b-4e88-8bc0-182997fdf004', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c28f192-b77b-425a-b26c-3d9329457268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Volume volume-392b759d-413b-4e88-8bc0-182997fdf004 (392b759d-413b-4e88-8bc0-182997fdf004): created successfully
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c28f192-b77b-425a-b26c-3d9329457268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (00c37ae3-d2f8-4de9-9595-bb46ee0668cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cb3436de-6143-4b58-a13e-65ac3979a090 tempest-GroupSnapshotsTest-128892063 None] Created volume successfully.
Sep 16 21:53:15 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c09d8c74-f74e-49f3-aa60-d80bb38191cf" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "cinder-quobyte-c09d8c74-f74e-49f3-aa60-d80bb38191cf" released by "delete_volume" :: held 0.943s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Created reservations ['3af0758f-e33f-4204-a87b-7dac90f941c3', '8aa65d19-379e-4cca-a18e-17c9248ad3ca', '2b4674f7-e806-4601-9ed6-1e8cba1f836f', 'b780db3c-31af-4d73-b9c6-3c476936bbe5'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:16 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:16 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:16 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 1073741824" returned: 0 in 0.615s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:16 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555
Sep 16 21:53:16 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:16 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Deleted volume successfully.
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e816b45a-272c-4b26-be3a-7d53c217d81b tempest-VolumesCloneNegativeTest-766895246 None] Lock "cinder-c09d8c74-f74e-49f3-aa60-d80bb38191cf-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:16 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79b0265-c46c-445f-b59a-3395a786a666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a33ed6-1af1-4d3e-84e6-1d86b2debfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Volume volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 (00ddcaf3-aa7a-4158-a78a-a5ffdc84c555): created successfully
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a33ed6-1af1-4d3e-84e6-1d86b2debfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Flow 'volume_create_manager' (5a5498ca-94c1-4988-aba1-d6c847bbb033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-30bf9033-1e1a-4f5f-ba49-216a82f6c23c tempest-ServerActionsTestOtherA-564357530 None] Created volume successfully.
Sep 16 21:53:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] GroupSnapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: creating.
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Group snapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: creating. {{(pid=85936) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Creating offline snapshot a4883fb8-3f80-43d1-93dc-bbdf7607a3bb of volume 392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[23879bbf-1ed0-43ab-b4ab-6449998f514c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:17 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:17 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:17 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:17 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb 1G
Sep 16 21:53:17 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:17 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb 1G" returned: 0 in 0.521s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392b759d-413b-4e88-8bc0-182997fdf004 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:18 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392b759d-413b-4e88-8bc0-182997fdf004 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:18 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:18 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392b759d-413b-4e88-8bc0-182997fdf004 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.541s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:53:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:18 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:18 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:18 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:18 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info
Sep 16 21:53:18 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:19 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info" returned: 0 in 0.420s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:19 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:53:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:19 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info
Sep 16 21:53:19 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:19 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.info" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7e95934b-281d-40d7-93e5-3def62411bd0 tempest-GroupSnapshotsTest-128892063 None] group_snapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: created successfully
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb-bef34fec-963e-4a9b-bfaf-183ab93a67d0" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb-bef34fec-963e-4a9b-bfaf-183ab93a67d0" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Creating volume bef34fec-963e-4a9b-bfaf-183ab93a67d0 from snapshot a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] snapshot: a4883fb8-3f80-43d1-93dc-bbdf7607a3bb, volume: bef34fec-963e-4a9b-bfaf-183ab93a67d0,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3b977e-35ac-4acc-ad33-8c8cf1b80eff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:21 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:21 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:21 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.517s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392b759d-413b-4e88-8bc0-182997fdf004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:53:22 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:22 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bab14d-dc6b-420c-8a7a-8408938ac66a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:22 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:22 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:22 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.442s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 8 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:53:22 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.578s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 21:53:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:22 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0
Sep 16 21:53:22 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Flow 'volume_create_manager' (3909c825-a9b6-4b9b-a5d0-0d6955055090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e4de1-bdfc-406f-9561-47089d0028ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e4de1-bdfc-406f-9561-47089d0028ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-331705503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bdc100-f456-433a-91d8-7e474c2b6b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f4c77fe2fbf4485824be1f6c0ed1c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:24Z,use_quota=True,user_id='c826a649b1db4cdbaa5fe63462d08a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce579d8b-fc13-4c84-92be-cec403bd0fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce579d8b-fc13-4c84-92be-cec403bd0fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e54a49-4e8a-4993-81bc-110fda19e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:24 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 21:53:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e54a49-4e8a-4993-81bc-110fda19e49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1bdc100-f456-433a-91d8-7e474c2b6b9e', 'volume_name': 'volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70410>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba273b3-4cfa-4764-b946-43b956c5bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba273b3-4cfa-4764-b946-43b956c5bae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eae47d5-2182-406f-9bdd-a189fd89565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Volume e1bdc100-f456-433a-91d8-7e474c2b6b9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70410>}
Sep 16 21:53:25 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Trying to clone e1bdc100-f456-433a-91d8-7e474c2b6b9e from image b2c54ab4-3980-45cd-a037-6930dcd310de at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 21:53:26 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD, size 20.69 MB, duration 1.21 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 21:53:26 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Image download 20.69 MB at 17.04 MB/s
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00ddb3-fe28-486b-92e9-d4730e8a5804]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:27 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD
Sep 16 21:53:27 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:27 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de is fetched for user c826a649b1db4cdbaa5fe63462d08a8e. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a12f6-7a52-4c7d-be33-6bb2f74d2f64]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:28 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD
Sep 16 21:53:28 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:29 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD" returned: 0 in 1.197s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Flow 'volume_create_manager' (eba2ed51-e0ce-497e-98d4-85a39bebd229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a50143-af56-4c8f-a6d3-7b2cc2d3c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a50143-af56-4c8f-a6d3-7b2cc2d3c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-487673300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6071ba2-5457-48fc-be94-62211835010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951be5a3c7f84544b2101562b100c2be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:32Z,use_quota=True,user_id='52a7326495424468b06f88ef9af44903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4395f4-ec55-4df2-ab22-d0b30aa3e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4395f4-ec55-4df2-ab22-d0b30aa3e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627d7f53-fb93-43f4-ab9f-dfa82cca4e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627d7f53-fb93-43f4-ab9f-dfa82cca4e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6071ba2-5457-48fc-be94-62211835010f', 'volume_name': 'volume-c6071ba2-5457-48fc-be94-62211835010f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be54546d-d238-4984-a9e6-6e461af0a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be54546d-d238-4984-a9e6-6e461af0a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6727d187-4d16-4227-b139-d2f4882a0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:31 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Volume c6071ba2-5457-48fc-be94-62211835010f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6071ba2-5457-48fc-be94-62211835010f', 'volume_size': 1}
Sep 16 21:53:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:33 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0" returned: 0 in 10.766s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004, size 1024.00 MB, duration 10.77 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:53:33 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Converted 1024.00 MB image at 95.10 MB/s
Sep 16 21:53:33 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:33 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0
Sep 16 21:53:33 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:33 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0" returned: 0 in 0.239s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" released by "_copy_volume_from_snapshot" :: held 12.234s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb-bef34fec-963e-4a9b-bfaf-183ab93a67d0" released by "_create_volume_from_snapshot" :: held 12.328s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.361s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.549s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-331705503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bdc100-f456-433a-91d8-7e474c2b6b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f4c77fe2fbf4485824be1f6c0ed1c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:24Z,use_quota=True,user_id='c826a649b1db4cdbaa5fe63462d08a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Creating volume e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:33 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:33 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1073741824
Sep 16 21:53:33 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d21842da-647e-403a-a8ac-cd36e640e333 tempest-GroupSnapshotsTest-128892063 None] Create group from source-snapshot-216ef09d-dd28-40f8-a10f-8efbf53b738e completed successfully.
Sep 16 21:53:34 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1073741824" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:34 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e
Sep 16 21:53:34 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:34 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.588s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-487673300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6071ba2-5457-48fc-be94-62211835010f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951be5a3c7f84544b2101562b100c2be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:32Z,use_quota=True,user_id='52a7326495424468b06f88ef9af44903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Creating volume c6071ba2-5457-48fc-be94-62211835010f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:34 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:34 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f 1073741824
Sep 16 21:53:34 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Attempting download of b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume e1bdc100-f456-433a-91d8-7e474c2b6b9e. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[990378f8-fa4c-4b30-a798-cd906521db12]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:34 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe
Sep 16 21:53:34 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b912828-7a92-425a-9a1a-d9016cd7140e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:34 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:35 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0
Sep 16 21:53:35 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f 1073741824" returned: 0 in 0.625s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:35 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe
Sep 16 21:53:35 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack sudo[89928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f
Sep 16 21:53:35 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0" returned: 0 in 0.445s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:35 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0
Sep 16 21:53:35 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe" returned: 1 in 0.499s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_2hz1rboe' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[377edf56-4a42-4e34-8d66-a1f4e9504b63]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:35 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6727d187-4d16-4227-b139-d2f4882a0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6071ba2-5457-48fc-be94-62211835010f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bcdca4-ace2-4dfa-b743-2f65f95f0dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Volume volume-c6071ba2-5457-48fc-be94-62211835010f (c6071ba2-5457-48fc-be94-62211835010f): created successfully
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bcdca4-ace2-4dfa-b743-2f65f95f0dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Flow 'volume_create_manager' (eba2ed51-e0ce-497e-98d4-85a39bebd229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a89292fe-f020-4b13-830d-bede12644603 tempest-AttachVolumeShelveTestJSON-595040740 None] Created volume successfully.
Sep 16 21:53:35 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD
Sep 16 21:53:35 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bef34fec-963e-4a9b-bfaf-183ab93a67d0" returned: 0 in 0.299s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-bef34fec-963e-4a9b-bfaf-183ab93a67d0" released by "delete_volume" :: held 0.798s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Created reservations ['c0b3b191-b2b6-4c9c-a607-e1dea8341d11'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:35 devstack cinder-volume[85936]: WARNING cinder.quota [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-577696125 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-577696125, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:53:35 devstack cinder-volume[85936]: WARNING cinder.quota [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-577696125 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-577696125, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Created reservations ['0b305e39-cb36-4342-88ad-a48e2c9e28f0', '4cc2042d-9991-433c-a892-038321ec34d5', '10afb3c8-f4a7-4bb0-babd-c31d02b8ddc2', '53bfea44-30af-4c63-88b3-72a4bdcea258'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:35 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] b2c54ab4-3980-45cd-a037-6930dcd310de was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:35 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e
Sep 16 21:53:35 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:36 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:36 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:36 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.361s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dafc892c-fcfb-4808-a2cf-09b4a609e1ba tempest-GroupSnapshotsTest-128892063 None] Delete group completed successfully.
Sep 16 21:53:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] group_snapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: deleting
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] group_snapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: deleting {{(pid=85936) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Deleting offline snapshot a4883fb8-3f80-43d1-93dc-bbdf7607a3bb of volume 392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] snapshot_file for this snap is: volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[363aff9f-9228-47a2-89a5-1be0a1f8b00c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:36 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:36 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:37 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.634s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392b759d-413b-4e88-8bc0-182997fdf004(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:53:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb9822f-5fe5-4ac2-8338-7e30fe6a111b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:37 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:37 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:38 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.777s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:38 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:38 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:38 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e" returned: 0 in 2.658s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_y5pbjtcgdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:53:38 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Converted 112.00 MB image at 42.11 MB/s
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:38 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.462s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:38 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1G
Sep 16 21:53:38 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:38 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb
Sep 16 21:53:38 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:38 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004.a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" returned: 0 in 0.340s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-a4883fb8-3f80-43d1-93dc-bbdf7607a3bb" released by "_delete_snapshot" :: held 2.349s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" released by "delete_snapshot" :: held 2.405s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:38 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 1G" returned: 0 in 0.452s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:38 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Downloaded image b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume e1bdc100-f456-433a-91d8-7e474c2b6b9e successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de for user c826a649b1db4cdbaa5fe63462d08a8e is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Marking volume e1bdc100-f456-433a-91d8-7e474c2b6b9e as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Copying metadata from image b2c54ab4-3980-45cd-a037-6930dcd310de to e1bdc100-f456-433a-91d8-7e474c2b6b9e. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Creating volume glance metadata for volume e1bdc100-f456-433a-91d8-7e474c2b6b9e backed by image b2c54ab4-3980-45cd-a037-6930dcd310de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 21:53:39 devstack cinder-volume[85936]: WARNING cinder.quota [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-577696125 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-577696125, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['c9c396d3-8ed8-4f7f-a33d-48c3fa1b9c4f', '05b59665-0b84-4293-b9d5-623006a31ec5', '3e914282-96a5-4bc9-9a6e-3edc80ebb461', '17105e94-187a-4092-90ac-a9188be48f54'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eae47d5-2182-406f-9bdd-a189fd89565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70410>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1802e-106b-4ef9-abbf-4363ef5cbb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:39 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Volume volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e (e1bdc100-f456-433a-91d8-7e474c2b6b9e): created successfully
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d1802e-106b-4ef9-abbf-4363ef5cbb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Flow 'volume_create_manager' (3909c825-a9b6-4b9b-a5d0-0d6955055090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e0e2ca81-52f9-43b1-9287-b26fd2a857fe tempest-VolumesExtendTest-985881069 None] Created volume successfully.
Sep 16 21:53:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-49cd8d51-97fe-4957-8f11-13686bb17224 tempest-GroupSnapshotsTest-128892063 None] group_snapshot 216ef09d-dd28-40f8-a10f-8efbf53b738e: deleted successfully
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2aacaa-fe18-4f5f-b107-a06f890371b7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:40 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e
Sep 16 21:53:40 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea244c-efb7-4b3d-8f01-8fd7438785f3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:40 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:40 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:40 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e" returned: 0 in 0.457s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 2G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e 2G" returned: 0 in 0.130s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.626s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8e451a50-3ff8-4a00-838a-55020ad7c41d tempest-VolumesExtendTest-985881069 None] Extend volume completed successfully.
Sep 16 21:53:40 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.439s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:40 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004
Sep 16 21:53:40 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:41 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-392b759d-413b-4e88-8bc0-182997fdf004" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-392b759d-413b-4e88-8bc0-182997fdf004" released by "delete_volume" :: held 0.780s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Created reservations ['d009afcc-607f-4b40-86fa-50d13e216dca'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:41 devstack cinder-volume[85936]: WARNING cinder.db.api [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-577696125']
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Created reservations ['911efe0f-ffe3-48cd-822d-0190fd96b0c8', '6216969b-dca3-43f9-b1d4-7da46859528e', '05b53dd0-536a-407c-8a37-87d90f1335fb', '1a7fde1f-cc69-421f-a2ac-b02425f30f56'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:41 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:41 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-e1bdc100-f456-433a-91d8-7e474c2b6b9e-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "cinder-e1bdc100-f456-433a-91d8-7e474c2b6b9e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-quobyte-e1bdc100-f456-433a-91d8-7e474c2b6b9e" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-e1bdc100-f456-433a-91d8-7e474c2b6b9e" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:41 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6bc0da9c-8fd5-4f81-b294-bbf5a7475a0c tempest-GroupSnapshotsTest-128892063 None] Delete group completed successfully.
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca0157-eeb8-45e6-9cc5-6f9aa85a8177]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:41 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e
Sep 16 21:53:41 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-32a9e629-c8b3-4f62-aada-c0faf858901e tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1082792243: creating
Sep 16 21:53:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-32a9e629-c8b3-4f62-aada-c0faf858901e tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1082792243: created successfully
Sep 16 21:53:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-32a9e629-c8b3-4f62-aada-c0faf858901e tempest-GroupSnapshotsTest-128892063 None] Create group completed successfully.
Sep 16 21:53:42 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e" returned: 0 in 0.456s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:42 devstack sudo[90084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e
Sep 16 21:53:42 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:42 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e1bdc100-f456-433a-91d8-7e474c2b6b9e" returned: 0 in 0.273s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-e1bdc100-f456-433a-91d8-7e474c2b6b9e" released by "delete_volume" :: held 0.790s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Created reservations ['e3b1e3ce-ea4e-49c7-a025-351f910a54d1', '1a81fa1c-971e-47e1-9a61-ac2d7d08054c', '1952b414-dc9f-4b6b-aebc-7698cf5a1c1b', '5882e0d6-7f9e-4368-87f7-ffae809fa02e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:42 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:42 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:42 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Deleted volume successfully.
Sep 16 21:53:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6b524467-277e-4ed8-b170-18db19199c1a tempest-VolumesExtendTest-985881069 None] Lock "cinder-e1bdc100-f456-433a-91d8-7e474c2b6b9e-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Flow 'volume_create_manager' (41838c81-3253-4ce1-b5f8-0d17fd09a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1915aeff-1413-4936-8270-2c1c9fdb71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1915aeff-1413-4936-8270-2c1c9fdb71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-501943042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeed7770-d78e-41ae-acf1-1a3849b241c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f4c77fe2fbf4485824be1f6c0ed1c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:43Z,use_quota=True,user_id='c826a649b1db4cdbaa5fe63462d08a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d3d4fa-d352-4d27-a5dc-0a92bb8dc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d3d4fa-d352-4d27-a5dc-0a92bb8dc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569059e8-d82a-4aaf-9d64-5ac3ecb5dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569059e8-d82a-4aaf-9d64-5ac3ecb5dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeed7770-d78e-41ae-acf1-1a3849b241c7', 'volume_name': 'volume-aeed7770-d78e-41ae-acf1-1a3849b241c7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df75dde-2ebe-4af0-ac0d-f77bd2c6b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df75dde-2ebe-4af0-ac0d-f77bd2c6b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55faca-368c-4934-be2b-7587426989fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Volume aeed7770-d78e-41ae-acf1-1a3849b241c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeed7770-d78e-41ae-acf1-1a3849b241c7', 'volume_size': 1}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-501943042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeed7770-d78e-41ae-acf1-1a3849b241c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f4c77fe2fbf4485824be1f6c0ed1c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:43Z,use_quota=True,user_id='c826a649b1db4cdbaa5fe63462d08a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Creating volume aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:43 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:43 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 1073741824
Sep 16 21:53:43 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (7be93486-e529-48b9-aa24-23af1286647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31543c67-80c9-4df6-9e2a-9ef971612019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31543c67-80c9-4df6-9e2a-9ef971612019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-967256864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,host='devstack@QuobyteHD#QuobyteHD',id=ebef8697-3f9d-4b05-a173-ba1c98abc2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:44Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9377fb-586c-48fa-bdca-6545dc37f3e5),volume_type_id=3d9377fb-586c-48fa-bdca-6545dc37f3e5)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6293367-84ce-45b3-bda9-67c0e69f8e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6293367-84ce-45b3-bda9-67c0e69f8e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96f4279-380c-4110-b508-da78a10b2b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96f4279-380c-4110-b508-da78a10b2b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebef8697-3f9d-4b05-a173-ba1c98abc2fa', 'volume_name': 'volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533a900-da85-4eb5-a11c-e2f81c275574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f533a900-da85-4eb5-a11c-e2f81c275574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f23ffcf-aaf9-4eec-80c0-c24268d983ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Volume ebef8697-3f9d-4b05-a173-ba1c98abc2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa', 'volume_size': 1}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:44 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 1073741824" returned: 0 in 0.685s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:44 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:44 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:44 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,created_at=2026-09-16T19:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-967256864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,host='devstack@QuobyteHD#QuobyteHD',id=ebef8697-3f9d-4b05-a173-ba1c98abc2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:44Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9377fb-586c-48fa-bdca-6545dc37f3e5),volume_type_id=3d9377fb-586c-48fa-bdca-6545dc37f3e5)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Creating volume ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:44 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e55faca-368c-4934-be2b-7587426989fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeed7770-d78e-41ae-acf1-1a3849b241c7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack sudo[90121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa 1073741824
Sep 16 21:53:44 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b71d83-a802-4f9e-a4a7-a05147d90f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Volume volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 (aeed7770-d78e-41ae-acf1-1a3849b241c7): created successfully
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b71d83-a802-4f9e-a4a7-a05147d90f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Flow 'volume_create_manager' (41838c81-3253-4ce1-b5f8-0d17fd09a955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-16afda13-0051-477e-afe4-ccb5a106d861 tempest-VolumesExtendTest-985881069 None] Created volume successfully.
Sep 16 21:53:44 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa 1073741824" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:45 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa
Sep 16 21:53:45 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:45 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f23ffcf-aaf9-4eec-80c0-c24268d983ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb2ca5d-ab40-4ee0-bfdb-d9aca415ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Volume volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa (ebef8697-3f9d-4b05-a173-ba1c98abc2fa): created successfully
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb2ca5d-ab40-4ee0-bfdb-d9aca415ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (7be93486-e529-48b9-aa24-23af1286647f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8e99734a-4d1d-49c3-8522-8e7ab31b1a85 tempest-GroupSnapshotsTest-128892063 None] Created volume successfully.
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-6786799c-adbb-40cc-903d-e49b95940a1d req-b520cac5-f0fd-4fa5-ae40-7308b172cd11 tempest-AttachVolumeShelveTestJSON-595040740 None] No connector for attachment 6d8f258e-fbff-4ef7-8801-66144a2f059c; skipping storage backend terminate_connection call. {{(pid=85936) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-6786799c-adbb-40cc-903d-e49b95940a1d req-b520cac5-f0fd-4fa5-ae40-7308b172cd11 tempest-AttachVolumeShelveTestJSON-595040740 None] Deleting attachment 6d8f258e-fbff-4ef7-8801-66144a2f059c. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Creating offline snapshot cd1d2699-160e-4296-b050-955f077093c6 of volume aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[866aba80-d047-41ef-b196-428e416160f7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:45 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:45 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:46 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.427s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:46 devstack sudo[90135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 1G
Sep 16 21:53:46 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:46 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 1G" returned: 0 in 0.579s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:46 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6
Sep 16 21:53:46 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:47 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6" returned: 0 in 0.454s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 is being set with open permissions: ugo+rw
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:47 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6
Sep 16 21:53:47 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (c057f499-dbd5-473b-9be9-e0516dc4c4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7fa727-e872-46a9-9621-72766723a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7fa727-e872-46a9-9621-72766723a901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385773742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,host='devstack@QuobyteHD#QuobyteHD',id=e4b2a428-1080-408a-ad6f-d6bbfefe3f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:47Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9377fb-586c-48fa-bdca-6545dc37f3e5),volume_type_id=3d9377fb-586c-48fa-bdca-6545dc37f3e5)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15324607-d484-42ec-9117-621bb4f5be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15324607-d484-42ec-9117-621bb4f5be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdc5148-7372-4c28-aba3-8812af884a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdc5148-7372-4c28-aba3-8812af884a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b2a428-1080-408a-ad6f-d6bbfefe3f63', 'volume_name': 'volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe17d89-d07c-4239-886c-aac503354b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe17d89-d07c-4239-886c-aac503354b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68750ff-3e57-4a89-8556-c48ec6ec4419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:47 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Volume e4b2a428-1080-408a-ad6f-d6bbfefe3f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63', 'volume_size': 1}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:47 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6" returned: 0 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:47 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info
Sep 16 21:53:47 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:47 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info is being set with open permissions: ugo+rw
Sep 16 21:53:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:47 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info
Sep 16 21:53:47 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:48 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.info" returned: 0 in 0.273s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,created_at=2026-09-16T19:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385773742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23620d5a-4fcf-42d1-844b-8bc3efbcd765,host='devstack@QuobyteHD#QuobyteHD',id=e4b2a428-1080-408a-ad6f-d6bbfefe3f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:53:47Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9377fb-586c-48fa-bdca-6545dc37f3e5),volume_type_id=3d9377fb-586c-48fa-bdca-6545dc37f3e5)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Creating volume e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:53:48 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:48 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 1073741824
Sep 16 21:53:48 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-903e8e8a-866d-47e5-9e54-b634ee8da3aa tempest-VolumesExtendTest-985881069 None] Create snapshot completed successfully
Sep 16 21:53:48 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 1073741824" returned: 0 in 0.547s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:48 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63
Sep 16 21:53:48 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:49 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" returned: 0 in 0.459s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.067s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68750ff-3e57-4a89-8556-c48ec6ec4419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033dad47-c68e-485e-a72f-b6f4c417b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c9546-0f90-4f1b-b51c-2992fdac5b7d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Volume volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 (e4b2a428-1080-408a-ad6f-d6bbfefe3f63): created successfully
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033dad47-c68e-485e-a72f-b6f4c417b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (c057f499-dbd5-473b-9be9-e0516dc4c4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:53:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d05aa587-476f-4bd0-ba17-ad554527f4ca tempest-GroupSnapshotsTest-128892063 None] Created volume successfully.
Sep 16 21:53:49 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:49 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:49 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 2G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 2G" returned: 0 in 0.161s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.590s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4cbce867-9272-4a97-9b5d-f8d8ca52dc9e tempest-VolumesExtendTest-985881069 None] Extend volume completed successfully.
Sep 16 21:53:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5f5a9a7b-8352-4cee-a310-aa79107b5a2c tempest-GroupSnapshotsTest-128892063 None] Update group completed successfully.
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-cd1d2699-160e-4296-b050-955f077093c6-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-cd1d2699-160e-4296-b050-955f077093c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-quobyte-cd1d2699-160e-4296-b050-955f077093c6" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-cd1d2699-160e-4296-b050-955f077093c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Deleting offline snapshot cd1d2699-160e-4296-b050-955f077093c6 of volume aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] snapshot_file for this snap is: volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef9ee3-04a4-40b3-9dc5-ac71ffecd8e1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:50 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6
Sep 16 21:53:50 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:51 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeed7770-d78e-41ae-acf1-1a3849b241c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8652dee5-223a-4b9d-b548-373b008fd40d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:51 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:51 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9697bb84-93a0-4923-8514-15946d307fd9 tempest-GroupSnapshotsTest-128892063 None] Update group completed successfully.
Sep 16 21:53:51 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:51 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6
Sep 16 21:53:51 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:51 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6" returned: 0 in 0.441s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:51 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6
Sep 16 21:53:51 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:52 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7.cd1d2699-160e-4296-b050-955f077093c6" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-cd1d2699-160e-4296-b050-955f077093c6" released by "_delete_snapshot" :: held 1.717s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" released by "delete_snapshot" :: held 1.743s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Created reservations ['70536e8f-c9db-4cec-8ceb-4b2c5cb4b752', '9e2e203b-3504-4027-a10e-30f47f275eb0', '5353c27c-7ffc-4b29-812a-f1d07a8baf44', 'de6fa689-c708-4c4f-871c-b51b322b8892'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-679c26c9-3d54-4d58-a2d4-7fdd3272efab tempest-GroupSnapshotsTest-128892063 None] Update group completed successfully.
Sep 16 21:53:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Delete snapshot completed successfully.
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-271b64aa-b7cf-449c-a4ce-abc996568851 tempest-VolumesExtendTest-985881069 None] Lock "cinder-cd1d2699-160e-4296-b050-955f077093c6-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-aeed7770-d78e-41ae-acf1-1a3849b241c7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "cinder-aeed7770-d78e-41ae-acf1-1a3849b241c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Acquiring lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23450b-8215-45c0-9a50-21a6776fadf0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:53 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:53 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c6ce4194-e3e6-4d0e-ba01-d46ac24ac429 req-7a8a3595-dce8-4f96-9dfa-44e7b7b9fb5b tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c6ce4194-e3e6-4d0e-ba01-d46ac24ac429 req-7a8a3595-dce8-4f96-9dfa-44e7b7b9fb5b tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c6ce4194-e3e6-4d0e-ba01-d46ac24ac429 req-7a8a3595-dce8-4f96-9dfa-44e7b7b9fb5b tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c6ce4194-e3e6-4d0e-ba01-d46ac24ac429 req-7a8a3595-dce8-4f96-9dfa-44e7b7b9fb5b tempest-ServerActionsTestOtherA-564357530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f69cd514-d2d1-41ff-98c7-80a3e4174304', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:53:53 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.448s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:53 devstack sudo[90263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7
Sep 16 21:53:53 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-c6ce4194-e3e6-4d0e-ba01-d46ac24ac429 req-7a8a3595-dce8-4f96-9dfa-44e7b7b9fb5b tempest-ServerActionsTestOtherA-564357530 None] attachment_update completed successfully.
Sep 16 21:53:53 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-aeed7770-d78e-41ae-acf1-1a3849b241c7" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d830aeb6-6f5b-4930-9b7a-e78d798d491d tempest-GroupSnapshotsTest-128892063 None] Update group completed successfully.
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "cinder-quobyte-aeed7770-d78e-41ae-acf1-1a3849b241c7" released by "delete_volume" :: held 0.907s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Created reservations ['bc9a24c5-7c02-400c-8440-8230a4f5e691', '308d9848-1f46-42bd-a877-2b981c2fda80', 'acec12b2-aae0-465b-9be2-234b2322801c', '369ac7e0-9a4b-4325-85e2-e7a274a02005'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:53 devstack sudo[90678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:53:53 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:54 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:54 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:53:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Deleted volume successfully.
Sep 16 21:53:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-985be7d5-cf16-4c00-9121-3ea61023ad6b tempest-VolumesExtendTest-985881069 None] Lock "cinder-aeed7770-d78e-41ae-acf1-1a3849b241c7-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:53:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] GroupSnapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: creating.
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Group snapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: creating. {{(pid=85936) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Creating offline snapshot 84147db6-5223-419e-b6aa-657d191e4c87 of volume ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b1da6-3bb7-464f-afc7-efa87f97259c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:56 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa
Sep 16 21:53:56 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:56 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" returned: 0 in 0.669s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:56 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 1G
Sep 16 21:53:56 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:57 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 1G" returned: 0 in 0.932s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:57 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87
Sep 16 21:53:57 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:58 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87" returned: 0 in 0.550s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:58 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:53:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:58 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87
Sep 16 21:53:58 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-bcab8550-06d7-4fc4-bcda-71bc93fe2484 tempest-ServerActionsTestOtherA-564357530 None] Terminate volume connection completed successfully.
Sep 16 21:53:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-bcab8550-06d7-4fc4-bcda-71bc93fe2484 tempest-ServerActionsTestOtherA-564357530 None] Deleting attachment f69cd514-d2d1-41ff-98c7-80a3e4174304. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:53:58 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87" returned: 0 in 0.406s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:58 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info
Sep 16 21:53:58 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:59 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info" returned: 0 in 0.624s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:59 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:59 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info
Sep 16 21:53:59 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:53:59 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.info" returned: 0 in 0.589s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.957s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Creating offline snapshot f5b132cb-8e46-460d-8f49-47c7d65129b4 of volume e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436303e-1cf3-4401-8fa6-b9c6d9a2c077]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:53:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-71b60b2c-7f7e-45ed-8a3d-79de875a3691 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:00 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63
Sep 16 21:54:00 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:00 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" returned: 0 in 0.476s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:00 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 1G
Sep 16 21:54:00 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:00 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 1G" returned: 0 in 0.457s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:00 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4
Sep 16 21:54:00 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:01 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4" returned: 0 in 0.342s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:01 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:01 devstack sudo[90854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4
Sep 16 21:54:01 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:01 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:01 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info
Sep 16 21:54:01 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (c127710e-6fce-4eac-9f0f-ed6122c0922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcf2a3-37a2-4b9e-90cd-220875b9d866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bcf2a3-37a2-4b9e-90cd-220875b9d866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1696137888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f1f643-8102-4587-a9e5-8d281401bf58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:02Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0a5a92-ff32-4475-b359-1cd3df11e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0a5a92-ff32-4475-b359-1cd3df11e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180171b0-1d1a-4f4c-a7fe-42fbf431d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180171b0-1d1a-4f4c-a7fe-42fbf431d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f1f643-8102-4587-a9e5-8d281401bf58', 'volume_name': 'volume-05f1f643-8102-4587-a9e5-8d281401bf58', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae619a2-ef91-4a76-9ed3-ec7727fe7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae619a2-ef91-4a76-9ed3-ec7727fe7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a824b14b-3d52-4224-a632-27d0f74c8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Volume 05f1f643-8102-4587-a9e5-8d281401bf58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f1f643-8102-4587-a9e5-8d281401bf58', 'volume_size': 1}
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:01 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info" returned: 0 in 0.282s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:01 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:01 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info
Sep 16 21:54:01 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:01 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.info" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-71b60b2c-7f7e-45ed-8a3d-79de875a3691 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.098s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-71b60b2c-7f7e-45ed-8a3d-79de875a3691 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1696137888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f1f643-8102-4587-a9e5-8d281401bf58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:02Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Creating volume 05f1f643-8102-4587-a9e5-8d281401bf58 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:02 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:02 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 1073741824
Sep 16 21:54:02 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-71b60b2c-7f7e-45ed-8a3d-79de875a3691 tempest-ServerActionsTestOtherA-564357530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50b7d8a8-9501-442f-ada2-e322a698c869', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:54:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-ebb37d37-aeee-4592-8c97-bf3f36f9bbee req-71b60b2c-7f7e-45ed-8a3d-79de875a3691 tempest-ServerActionsTestOtherA-564357530 None] attachment_update completed successfully.
Sep 16 21:54:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6024e485-8043-4f0f-b57a-73fca3005e9d tempest-GroupSnapshotsTest-128892063 None] group_snapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: created successfully
Sep 16 21:54:02 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 1073741824" returned: 0 in 0.687s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] group_snapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: deleting
Sep 16 21:54:02 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58
Sep 16 21:54:02 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] group_snapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: deleting {{(pid=85936) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-84147db6-5223-419e-b6aa-657d191e4c87" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-84147db6-5223-419e-b6aa-657d191e4c87" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Deleting offline snapshot 84147db6-5223-419e-b6aa-657d191e4c87 of volume ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] snapshot_file for this snap is: volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[44540f73-918a-48f5-b1b6-5c7827e9c947]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:03 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58" returned: 0 in 0.401s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a824b14b-3d52-4224-a632-27d0f74c8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f1f643-8102-4587-a9e5-8d281401bf58', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa0b07-32e0-42f0-8ad8-66d914deb6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Volume volume-05f1f643-8102-4587-a9e5-8d281401bf58 (05f1f643-8102-4587-a9e5-8d281401bf58): created successfully
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa0b07-32e0-42f0-8ad8-66d914deb6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:03 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87
Sep 16 21:54:03 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (c127710e-6fce-4eac-9f0f-ed6122c0922b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6aeedaf9-5c2f-453d-a6f5-245106a7483a tempest-VolumesListTestJSON-1808165442 None] Created volume successfully.
Sep 16 21:54:03 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87" returned: 0 in 0.511s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d04227-0d7c-4ee3-9551-aabf725c70ab]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:03 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa
Sep 16 21:54:03 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:04 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" returned: 0 in 0.636s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:04 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87
Sep 16 21:54:04 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:05 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (2b530ea9-d2c7-4412-90ee-bde45130c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9941c6c-903f-4fdc-85a6-18e04155ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87" returned: 0 in 0.799s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9941c6c-903f-4fdc-85a6-18e04155ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-462416288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12045afd-8030-49a0-b069-740893cc8f7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:05Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:05 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87
Sep 16 21:54:05 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11efa8ca-acd7-445c-b148-8d07bbad19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11efa8ca-acd7-445c-b148-8d07bbad19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4dd63e4-6608-4580-bfbf-2854efd6521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4dd63e4-6608-4580-bfbf-2854efd6521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12045afd-8030-49a0-b069-740893cc8f7a', 'volume_name': 'volume-12045afd-8030-49a0-b069-740893cc8f7a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd776671-9fe2-4a98-8ae1-9b850ac18675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd776671-9fe2-4a98-8ae1-9b850ac18675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4b79a7-6090-47f1-ab05-fe398a0360d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Volume 12045afd-8030-49a0-b069-740893cc8f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12045afd-8030-49a0-b069-740893cc8f7a', 'volume_size': 1}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-462416288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12045afd-8030-49a0-b069-740893cc8f7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:05Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Creating volume 12045afd-8030-49a0-b069-740893cc8f7a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:05 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:05 devstack sudo[91364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a 1073741824
Sep 16 21:54:05 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:05 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa.84147db6-5223-419e-b6aa-657d191e4c87" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-84147db6-5223-419e-b6aa-657d191e4c87" released by "_delete_snapshot" :: held 2.540s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" released by "delete_snapshot" :: held 2.582s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-f5b132cb-8e46-460d-8f49-47c7d65129b4" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-f5b132cb-8e46-460d-8f49-47c7d65129b4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Deleting offline snapshot f5b132cb-8e46-460d-8f49-47c7d65129b4 of volume e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] snapshot_file for this snap is: volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0e9425-8f61-448b-89e9-c0287d5379a7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:05 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4
Sep 16 21:54:05 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:05 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a 1073741824" returned: 0 in 0.536s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:05 devstack sudo[91373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a
Sep 16 21:54:05 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:06 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4" returned: 0 in 0.566s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f3018-99ca-454a-8941-7c04d2963ccb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:06 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a" returned: 0 in 0.507s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4b79a7-6090-47f1-ab05-fe398a0360d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12045afd-8030-49a0-b069-740893cc8f7a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57420c6-2897-49f6-b349-3eca51ad08b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:06 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63
Sep 16 21:54:06 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Volume volume-12045afd-8030-49a0-b069-740893cc8f7a (12045afd-8030-49a0-b069-740893cc8f7a): created successfully
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57420c6-2897-49f6-b349-3eca51ad08b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (2b530ea9-d2c7-4412-90ee-bde45130c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:06 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-de31b437-8fa1-4f77-baf5-9c09acc6497e tempest-VolumesListTestJSON-1808165442 None] Created volume successfully.
Sep 16 21:54:06 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" returned: 0 in 0.623s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:06 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4
Sep 16 21:54:06 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:07 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4" returned: 0 in 0.526s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:07 devstack sudo[91393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4
Sep 16 21:54:07 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:07 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63.f5b132cb-8e46-460d-8f49-47c7d65129b4" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-f5b132cb-8e46-460d-8f49-47c7d65129b4" released by "_delete_snapshot" :: held 2.296s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" released by "delete_snapshot" :: held 2.327s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (8613f5e3-7951-47fa-8042-c45d7f3a7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cc82d4-8fe5-43a8-ab84-3c9bbc5d8c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cc82d4-8fe5-43a8-ab84-3c9bbc5d8c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-456071786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cf3dad-e043-4717-ba03-d2268a83e03e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:08Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8341b6-e4f1-4d85-adec-a133ce5139ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8341b6-e4f1-4d85-adec-a133ce5139ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1deece78-16fc-46de-8e58-c0296ea8d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1deece78-16fc-46de-8e58-c0296ea8d80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6cf3dad-e043-4717-ba03-d2268a83e03e', 'volume_name': 'volume-e6cf3dad-e043-4717-ba03-d2268a83e03e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848ba7c-325b-432e-822d-e99f19d2d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7848ba7c-325b-432e-822d-e99f19d2d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d896b3-bc5b-458a-b73e-01c364a6f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Volume e6cf3dad-e043-4717-ba03-d2268a83e03e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6cf3dad-e043-4717-ba03-d2268a83e03e', 'volume_size': 1}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-456071786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cf3dad-e043-4717-ba03-d2268a83e03e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da621d5ab7d14e1eb5b99be0fb8751c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:08Z,use_quota=True,user_id='beb0396f1db248d2a92c8b1fd4de26a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Creating volume e6cf3dad-e043-4717-ba03-d2268a83e03e {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:08 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:08 devstack sudo[91396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e 1073741824
Sep 16 21:54:08 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:08 devstack cinder-volume[85936]: WARNING cinder.quota [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1800094852 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1800094852, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:08 devstack cinder-volume[85936]: WARNING cinder.quota [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1800094852 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1800094852, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['75031079-80ed-4249-af1b-8012845f03d3', '0cba14dc-8069-41dd-81c2-4b76dd2506c5', '603781f5-1322-45e5-9cb3-6391a5ce30d1', '79424f99-b11a-4a91-9b80-872fe95b2361'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['1d186690-0ed5-403a-830c-d9fc64cca8e8', '4137048a-e94f-4e12-8eb0-f06a10324060', '84b47f66-7d72-4884-adbe-7dd8f51cbb0e', '58daa677-f477-46bd-8c96-36b9ab7561ac'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e036e3bc-ff25-435b-8cd3-853b6b2237e0 tempest-GroupSnapshotsTest-128892063 None] group_snapshot fd7d7c25-e842-45f2-8293-56d5542f74d4: deleted successfully
Sep 16 21:54:08 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e 1073741824" returned: 0 in 0.825s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:08 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e
Sep 16 21:54:08 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:09 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e" returned: 0 in 0.299s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d896b3-bc5b-458a-b73e-01c364a6f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6cf3dad-e043-4717-ba03-d2268a83e03e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e4e718-6ce2-4dbe-b0e4-c570ef96b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Volume volume-e6cf3dad-e043-4717-ba03-d2268a83e03e (e6cf3dad-e043-4717-ba03-d2268a83e03e): created successfully
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e4e718-6ce2-4dbe-b0e4-c570ef96b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Flow 'volume_create_manager' (8613f5e3-7951-47fa-8042-c45d7f3a7135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-272d162b-613e-4ebe-98bc-95b2e2de377b tempest-VolumesListTestJSON-1808165442 None] Created volume successfully.
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ed885-c16f-4191-bf14-d81d267cb6b2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:09 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63
Sep 16 21:54:09 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:09 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" returned: 0 in 0.429s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:09 devstack sudo[91425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63
Sep 16 21:54:09 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:10 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" returned: 0 in 0.313s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-e4b2a428-1080-408a-ad6f-d6bbfefe3f63" released by "delete_volume" :: held 0.840s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a293f-21fe-42f4-afa0-6af5b8991574]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:10 devstack sudo[91428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa
Sep 16 21:54:10 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:10 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" returned: 0 in 0.402s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:10 devstack sudo[91433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa
Sep 16 21:54:10 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:10 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" returned: 0 in 0.263s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-ebef8697-3f9d-4b05-a173-ba1c98abc2fa" released by "delete_volume" :: held 0.744s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['b6ff2b2a-a4a4-4ae7-ac98-e2c8c618f5b7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:11 devstack cinder-volume[85936]: WARNING cinder.quota [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1800094852 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1800094852, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['3bc1c6a8-f336-4be2-9429-7fdd0c005315', 'e145bcdd-66e6-48eb-8954-c2b5a5cc4002', '7f017cb2-394e-4a5c-b132-72e834136bd6', '5cca6770-45b2-4bfb-afae-5208bd4d1aad'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Created reservations ['524f08fc-17ce-47c8-8609-95a7b652323e', '697f494c-24d5-41c0-9c4d-3c33f5289ced', 'f82ab786-81c7-4ade-adfe-330a8899c25f', '8e41491e-87d3-4670-8f1f-ff0aeedc9553'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:11 devstack sudo[91436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:11 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:11 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:11 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d1e37d77-981b-4147-a89e-e044054c4ee5 tempest-GroupSnapshotsTest-128892063 None] Delete group completed successfully.
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=157,cinder:UPDATE=145,cinder:DELETE=7,cinder:INSERT=35 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:54:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a0469610-cdf7-4e09-9968-542146e7e5f7 tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1204079855: creating
Sep 16 21:54:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a0469610-cdf7-4e09-9968-542146e7e5f7 tempest-GroupSnapshotsTest-128892063 None] Group tempest-GroupSnapshotsTest-Group-1204079855: created successfully
Sep 16 21:54:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a0469610-cdf7-4e09-9968-542146e7e5f7 tempest-GroupSnapshotsTest-128892063 None] Create group completed successfully.
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-e6cf3dad-e043-4717-ba03-d2268a83e03e-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-e6cf3dad-e043-4717-ba03-d2268a83e03e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=150,cinder:SELECT=148,cinder:INSERT=41,cinder:DELETE=8 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-quobyte-e6cf3dad-e043-4717-ba03-d2268a83e03e" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-e6cf3dad-e043-4717-ba03-d2268a83e03e" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff9dca8-ef14-4d36-b1c8-4feaff4f9c56]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:12 devstack sudo[91440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e
Sep 16 21:54:12 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:13 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e" returned: 0 in 0.360s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:13 devstack sudo[91445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e
Sep 16 21:54:13 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:13 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e6cf3dad-e043-4717-ba03-d2268a83e03e" returned: 0 in 0.264s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-e6cf3dad-e043-4717-ba03-d2268a83e03e" released by "delete_volume" :: held 0.672s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Created reservations ['700dd164-571d-4b23-b85b-9ff44d191911', 'cc2a62d0-7d0d-446e-9129-7a89d6f8e1a7', 'feede552-a709-43c7-830e-ac3880228282', 'a61a1541-9393-4bde-b654-9e235213350a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:13 devstack sudo[91448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:13 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:13 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.336s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Deleted volume successfully.
Sep 16 21:54:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-110cdb14-8777-4346-9a62-4d1677f55026 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-e6cf3dad-e043-4717-ba03-d2268a83e03e-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (3e8850b5-b151-4992-8dd4-2cdbf0756d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436dd99-ab82-4adb-9950-bd5bf74cd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-12045afd-8030-49a0-b069-740893cc8f7a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436dd99-ab82-4adb-9950-bd5bf74cd94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386223999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a8e9933d-b5af-4f5c-b00a-866964bc17b7,host='devstack@QuobyteHD#QuobyteHD',id=6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:14Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce8e6cf-fd37-45b0-b68c-0e7959de2c5b),volume_type_id=5ce8e6cf-fd37-45b0-b68c-0e7959de2c5b)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd5b6ac-ee53-4c42-8164-4833dc928233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd5b6ac-ee53-4c42-8164-4833dc928233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85394de7-a14d-4742-9953-e2f3b519efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85394de7-a14d-4742-9953-e2f3b519efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4', 'volume_name': 'volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2183e4-ab75-4b51-8f77-80de806ae906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2183e4-ab75-4b51-8f77-80de806ae906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bc3cd3-20e2-4712-bb43-1bfee7f2cd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Volume 6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4', 'volume_size': 1}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a8e9933d-b5af-4f5c-b00a-866964bc17b7,created_at=2026-09-16T19:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1386223999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a8e9933d-b5af-4f5c-b00a-866964bc17b7,host='devstack@QuobyteHD#QuobyteHD',id=6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ebe6eae20b41c99c157ceb68dc425a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:14Z,use_quota=True,user_id='4b98ecde328345a7b6898d5161f9cfd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce8e6cf-fd37-45b0-b68c-0e7959de2c5b),volume_type_id=5ce8e6cf-fd37-45b0-b68c-0e7959de2c5b)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Creating volume 6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-12045afd-8030-49a0-b069-740893cc8f7a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:14 devstack sudo[91451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 1073741824
Sep 16 21:54:14 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-quobyte-12045afd-8030-49a0-b069-740893cc8f7a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-12045afd-8030-49a0-b069-740893cc8f7a" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff2168-addd-4b7f-9fc9-a138ee5af74f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:14 devstack sudo[91453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a
Sep 16 21:54:14 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:14 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 1073741824" returned: 0 in 0.448s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:14 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4
Sep 16 21:54:14 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:14 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:14 devstack sudo[91463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a
Sep 16 21:54:14 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:14 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bc3cd3-20e2-4712-bb43-1bfee7f2cd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279cf019-b988-4ce3-b488-cf2f9a620178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Volume volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 (6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4): created successfully
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279cf019-b988-4ce3-b488-cf2f9a620178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Flow 'volume_create_manager' (3e8850b5-b151-4992-8dd4-2cdbf0756d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-79bbfbbd-c1ce-49e4-99a2-4885891a7b8e tempest-GroupSnapshotsTest-128892063 None] Created volume successfully.
Sep 16 21:54:14 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-12045afd-8030-49a0-b069-740893cc8f7a" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-12045afd-8030-49a0-b069-740893cc8f7a" released by "delete_volume" :: held 0.798s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Created reservations ['112b4507-af49-4675-a20b-fe1baf9a01fb', '86c897fb-4416-446a-a0e2-6b51acfcd033', '1c7bb8b3-41cf-42b9-a3c9-c4a972c049f5', '1a278e7f-348a-4c35-b7e2-e05e758bdcdc'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:15 devstack sudo[91467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:15 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-05f1f643-8102-4587-a9e5-8d281401bf58-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-05f1f643-8102-4587-a9e5-8d281401bf58-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "cinder-quobyte-05f1f643-8102-4587-a9e5-8d281401bf58" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-05f1f643-8102-4587-a9e5-8d281401bf58" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd227d-bd22-4af5-bfc0-53a086dcf711]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] GroupSnapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: creating.
Sep 16 21:54:15 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.464s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:15 devstack sudo[91469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58
Sep 16 21:54:15 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Deleted volume successfully.
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Group snapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: creating. {{(pid=85936) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Creating offline snapshot 6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 of volume 6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9083f51a-75fe-431c-9898-42abe5e20298 tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-12045afd-8030-49a0-b069-740893cc8f7a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ffb00b-2116-46f6-94fa-08cea6e6c20a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:15 devstack sudo[91472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4
Sep 16 21:54:15 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:16 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58" returned: 0 in 0.623s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:16 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58
Sep 16 21:54:16 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:16 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" returned: 0 in 0.491s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:16 devstack sudo[91482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 1G
Sep 16 21:54:16 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:16 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05f1f643-8102-4587-a9e5-8d281401bf58" returned: 0 in 0.350s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-quobyte-05f1f643-8102-4587-a9e5-8d281401bf58" released by "delete_volume" :: held 1.042s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Created reservations ['1b466fe3-909a-4a47-86d7-2d652e44bdec', '23771fc0-8f71-45bc-b9dd-c846503793a4', '42c40afc-b075-45d0-befb-a8c283dc4737', '62ac7cb4-da3c-45a1-9550-08cb2837424e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:16 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:16 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:16 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 1G" returned: 0 in 0.554s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:16 devstack sudo[91491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64
Sep 16 21:54:16 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:16 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:16 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Deleted volume successfully.
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fecd5274-b084-4229-be02-743994bc0f9e tempest-VolumesListTestJSON-1808165442 None] Lock "cinder-05f1f643-8102-4587-a9e5-8d281401bf58-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:17 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" returned: 0 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:17 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:17 devstack sudo[91499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64
Sep 16 21:54:17 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:17 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:17 devstack sudo[91502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info
Sep 16 21:54:17 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:17 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:17 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:17 devstack sudo[91505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info
Sep 16 21:54:17 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:18 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.info" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-00c85c64-0199-4e64-b306-164e07e3c287 tempest-GroupSnapshotsTest-128892063 None] group_snapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: created successfully
Sep 16 21:54:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] group_snapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: deleting
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] group_snapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: deleting {{(pid=85936) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Deleting offline snapshot 6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 of volume 6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] snapshot_file for this snap is: volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[35984068-50ba-4edc-97b4-7b8092e90549]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:19 devstack sudo[91543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64
Sep 16 21:54:19 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:20 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" returned: 0 in 1.005s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad18b31d-8063-4018-9cf0-0ecbdce8e052]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:20 devstack sudo[91592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4
Sep 16 21:54:20 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:20 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" returned: 0 in 0.530s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:21 devstack sudo[91599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64
Sep 16 21:54:21 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:21 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" returned: 0 in 0.492s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:21 devstack sudo[91606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64
Sep 16 21:54:21 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:21 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4.6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6ba510fa-e40c-45d7-9ed4-e1c0711b5f64" released by "_delete_snapshot" :: held 2.626s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" released by "delete_snapshot" :: held 2.681s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:22 devstack sudo[91612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:22 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:22 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1452776074 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1452776074, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:22 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1452776074 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1452776074, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] Created reservations ['fc89b542-ec28-4055-ad05-3fa389ea1f9c', '7a637ede-538b-4e61-84f0-afbcae355127', 'e7600da1-f894-410e-b1b4-85049de2ec69', '86b8e9dc-8ee8-46d2-9860-14507ecc73c4'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1d1914ad-9274-43e4-b77b-90443b76ab9d tempest-GroupSnapshotsTest-128892063 None] group_snapshot 74c6c1e2-c208-4020-9755-1c0a8f5bea44: deleted successfully
Sep 16 21:54:22 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.320s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Flow 'volume_create_manager' (40a62725-a362-4605-b7d5-1a945db538f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b704575-34ea-4c2d-a951-3848d760565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b704575-34ea-4c2d-a951-3848d760565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-841976381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcea9781c542408eb89f4ed4dd4026fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:23Z,use_quota=True,user_id='c100947227ce4d8a8523794252ba4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43c3423-d4af-42e8-8ed8-b74c30c16362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43c3423-d4af-42e8-8ed8-b74c30c16362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264288ca-ee0e-4106-9967-051b199dd5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264288ca-ee0e-4106-9967-051b199dd5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3', 'volume_name': 'volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac91619-2542-453a-b24d-35ff298b23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac91619-2542-453a-b24d-35ff298b23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e2c49e-19f9-4362-ae5c-85fc7a00cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:23 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3', 'volume_size': 1}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-841976381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcea9781c542408eb89f4ed4dd4026fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:23Z,use_quota=True,user_id='c100947227ce4d8a8523794252ba4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Creating volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:23 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:23 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 1073741824
Sep 16 21:54:23 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba5579-9ff9-4256-885e-311e0788e06e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:23 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4
Sep 16 21:54:23 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:23 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 1073741824" returned: 0 in 0.523s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:23 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3
Sep 16 21:54:23 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:23 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" returned: 0 in 0.425s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:23 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4
Sep 16 21:54:23 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Acquiring lock "cinder-c6071ba2-5457-48fc-be94-62211835010f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "cinder-c6071ba2-5457-48fc-be94-62211835010f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Acquiring lock "cinder-quobyte-c6071ba2-5457-48fc-be94-62211835010f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:23 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "cinder-quobyte-c6071ba2-5457-48fc-be94-62211835010f" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" returned: 0 in 0.337s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e2c49e-19f9-4362-ae5c-85fc7a00cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41165a95-2174-4f82-b103-ed6cdbffae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b72926-782a-4d92-ad7c-8a74eb29ed45]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:24 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Volume volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 (c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3): created successfully
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41165a95-2174-4f82-b103-ed6cdbffae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Flow 'volume_create_manager' (40a62725-a362-4605-b7d5-1a945db538f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Lock "cinder-quobyte-6565ecdc-8dbd-46ec-ae46-fb8553a5d5c4" released by "delete_volume" :: held 0.837s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-206d0f72-a89d-49e0-94fb-d9a9bc408c61 tempest-VolumesSnapshotListTestJSON-1091623863 None] Created volume successfully.
Sep 16 21:54:24 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f
Sep 16 21:54:24 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Created reservations ['a04e004b-ce8b-4153-9c3c-9e718c5f266e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:24 devstack cinder-volume[85936]: WARNING cinder.quota [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1452776074 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1452776074, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Created reservations ['17834c9a-0c8d-43da-b269-93dcaef5a0df', 'bb8721fc-4ba7-4238-b5c3-c67a4cd80ea6', '2c308d09-721d-40dc-8f3b-200e48602f95', '92664924-50ee-4153-b154-d9c0b1fcc99e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:24 devstack sudo[91657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:24 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:24 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:24 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f
Sep 16 21:54:24 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:24 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bacd9206-8b44-4885-a0af-4d65095429bf tempest-GroupSnapshotsTest-128892063 None] Delete group completed successfully.
Sep 16 21:54:24 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c6071ba2-5457-48fc-be94-62211835010f" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "cinder-quobyte-c6071ba2-5457-48fc-be94-62211835010f" released by "delete_volume" :: held 0.728s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Created reservations ['5797c19d-41d8-45ad-8dad-50b3ae8cb784', 'c5b46f69-839b-4a89-8ef5-d53169dadb07', '7d1fb127-08db-421b-89c5-d2eb77590260', '7bc84118-b5f8-4915-8452-30e68e297f7a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:24 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:24 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:25 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.302s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Deleted volume successfully.
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3da2bafb-1bc8-4fe1-91f6-1421298bee18 tempest-AttachVolumeShelveTestJSON-595040740 None] Lock "cinder-c6071ba2-5457-48fc-be94-62211835010f-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Creating offline snapshot 287d5bff-0647-4742-8f6b-0187c99ada1b of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d68035-9c14-4b4f-bd41-7cd5b3c701b0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:25 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3
Sep 16 21:54:25 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:25 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:25 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b 1G
Sep 16 21:54:25 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:26 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b 1G" returned: 0 in 0.480s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:26 devstack sudo[91681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:26 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:26 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.342s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:26 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b is being set with open permissions: ugo+rw
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:26 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:26 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:26 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:26 devstack sudo[91691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info
Sep 16 21:54:26 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:27 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info" returned: 0 in 0.304s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:27 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info is being set with open permissions: ugo+rw
Sep 16 21:54:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:27 devstack sudo[91694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info
Sep 16 21:54:27 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:27 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.info" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-77933cc1-341b-4075-b701-f94a364a0e59 tempest-VolumesSnapshotListTestJSON-1091623863 None] Create snapshot completed successfully
Sep 16 21:54:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Creating offline snapshot af1095e2-1b85-46bb-ac12-6edca70637d5 of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4046b-6af4-40a8-abd6-cd9d8f2d165d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:29 devstack sudo[91697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:29 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:29 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.566s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:29 devstack sudo[91702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 1G
Sep 16 21:54:29 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:29 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 1G" returned: 0 in 0.601s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:30 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:30 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:30 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.339s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:30 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 is being set with open permissions: ugo+rw
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:30 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:30 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:30 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:30 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2220696b-a5a1-4a2f-a3f5-d8c7b90f55ce tempest-VolumesSnapshotListTestJSON-1091623863 None] Create snapshot completed successfully
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Creating offline snapshot a2cebaab-480d-45ee-9f13-6537ea3534ca of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32cd1e-82e3-485a-bbbe-395f6b915c46]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:31 devstack sudo[91719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:31 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4ed216c7-1f74-431b-aa43-21c91d3e65e1 tempest-GroupSnapshotsV319Test-246870821 None] Group tempest-GroupSnapshotsV319Test-Group-1233672088: creating
Sep 16 21:54:31 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.497s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4ed216c7-1f74-431b-aa43-21c91d3e65e1 tempest-GroupSnapshotsV319Test-246870821 None] Group tempest-GroupSnapshotsV319Test-Group-1233672088: created successfully
Sep 16 21:54:31 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca 1G
Sep 16 21:54:31 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4ed216c7-1f74-431b-aa43-21c91d3e65e1 tempest-GroupSnapshotsV319Test-246870821 None] Create group completed successfully.
Sep 16 21:54:32 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca 1G" returned: 0 in 0.626s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:32 devstack sudo[91733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca
Sep 16 21:54:32 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-a9d2c562-d25c-4f11-8b1a-c8e0d1846c9b req-0125f3da-0a12-406c-9144-5da2e2326a45 tempest-ServerActionsTestOtherA-564357530 None] Terminate volume connection completed successfully.
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-a9d2c562-d25c-4f11-8b1a-c8e0d1846c9b req-0125f3da-0a12-406c-9144-5da2e2326a45 tempest-ServerActionsTestOtherA-564357530 None] Deleting attachment 50b7d8a8-9501-442f-ada2-e322a698c869. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:54:32 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:32 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca is being set with open permissions: ugo+rw
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:32 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca
Sep 16 21:54:32 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:32 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-efd868de-5f93-40d8-9fd4-34d14da52d99 tempest-VolumesSnapshotListTestJSON-1091623863 None] Create snapshot completed successfully
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Flow 'volume_create_manager' (f9be5c73-90cd-4628-825b-bee7fec3b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52972861-e425-4d9f-a56e-35c5b18e286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52972861-e425-4d9f-a56e-35c5b18e286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519396944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1f494a56-72e7-47ab-bebd-1c542362a32f,host='devstack@QuobyteHD#QuobyteHD',id=7d1f2272-df07-47e3-aea9-036c81494cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2fa02981954aa8a2e3a73873732b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:33Z,use_quota=True,user_id='ce9b6186188c46cbacb8560c4b07b77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6857d2b1-fa27-448f-8068-1b06091b0182),volume_type_id=6857d2b1-fa27-448f-8068-1b06091b0182)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783d7797-8f4f-42e3-95a2-fc2ddce21bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783d7797-8f4f-42e3-95a2-fc2ddce21bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a82fc2c-ba41-475e-804d-450ce931b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a82fc2c-ba41-475e-804d-450ce931b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1f2272-df07-47e3-aea9-036c81494cc3', 'volume_name': 'volume-7d1f2272-df07-47e3-aea9-036c81494cc3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2539674a-3ff2-4abb-a79e-94f99e39795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2539674a-3ff2-4abb-a79e-94f99e39795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e7d995-ee42-4592-b207-78b8fe4389e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Volume 7d1f2272-df07-47e3-aea9-036c81494cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1f2272-df07-47e3-aea9-036c81494cc3', 'volume_size': 1}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1f494a56-72e7-47ab-bebd-1c542362a32f,created_at=2026-09-16T19:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519396944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1f494a56-72e7-47ab-bebd-1c542362a32f,host='devstack@QuobyteHD#QuobyteHD',id=7d1f2272-df07-47e3-aea9-036c81494cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2fa02981954aa8a2e3a73873732b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:33Z,use_quota=True,user_id='ce9b6186188c46cbacb8560c4b07b77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6857d2b1-fa27-448f-8068-1b06091b0182),volume_type_id=6857d2b1-fa27-448f-8068-1b06091b0182)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Creating volume 7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:33 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:33 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 1073741824
Sep 16 21:54:33 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:34 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 1073741824" returned: 0 in 0.843s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:34 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3
Sep 16 21:54:34 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-a2cebaab-480d-45ee-9f13-6537ea3534ca-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-a2cebaab-480d-45ee-9f13-6537ea3534ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-a2cebaab-480d-45ee-9f13-6537ea3534ca" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-a2cebaab-480d-45ee-9f13-6537ea3534ca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Deleting offline snapshot a2cebaab-480d-45ee-9f13-6537ea3534ca of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] snapshot_file for this snap is: volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b4b40-60b4-408a-9dff-c39e71997d3c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:34 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3" returned: 0 in 0.430s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e7d995-ee42-4592-b207-78b8fe4389e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1f2272-df07-47e3-aea9-036c81494cc3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0d722e-5364-48ce-b83a-1d477c7d3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Volume volume-7d1f2272-df07-47e3-aea9-036c81494cc3 (7d1f2272-df07-47e3-aea9-036c81494cc3): created successfully
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0d722e-5364-48ce-b83a-1d477c7d3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:35 devstack sudo[91775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca
Sep 16 21:54:35 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Flow 'volume_create_manager' (f9be5c73-90cd-4628-825b-bee7fec3b63a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-10089029-5bee-488e-b25e-c90b18dfb364 tempest-GroupSnapshotsV319Test-246870821 None] Created volume successfully.
Sep 16 21:54:35 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca" returned: 0 in 0.522s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8e4fd-c270-45fd-b1b8-6a43301f9e64]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:35 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:35 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:35 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.523s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:36 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca
Sep 16 21:54:36 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] GroupSnapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: creating.
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Group snapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: creating. {{(pid=85936) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Creating offline snapshot 0403b2e3-b233-45be-a48b-97320ee81b7d of volume 7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48f6fd-7d82-43a6-a874-b2a029577005]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:36 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3
Sep 16 21:54:36 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:36 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca" returned: 0 in 0.623s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:36 devstack sudo[91797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca
Sep 16 21:54:36 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:36 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3" returned: 0 in 0.436s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:36 devstack sudo[91803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d 1G
Sep 16 21:54:36 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:36 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.a2cebaab-480d-45ee-9f13-6537ea3534ca" returned: 0 in 0.317s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-a2cebaab-480d-45ee-9f13-6537ea3534ca" released by "_delete_snapshot" :: held 2.122s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" released by "delete_snapshot" :: held 2.146s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Created reservations ['caaf92b5-8233-4fb9-a071-b4d7e5e59dc5', '72d7fa4b-eeaf-48e4-ac31-30484c8282e9', '67b66c7d-0c18-43df-8bab-f4c8efb3e2bf', '1d829b4c-95a6-49b2-a6df-a0e24085cf51'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Delete snapshot completed successfully.
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dbc8b5b-62b1-48fc-b992-c36739b14725 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-a2cebaab-480d-45ee-9f13-6537ea3534ca-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:37 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d 1G" returned: 0 in 0.603s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1f2272-df07-47e3-aea9-036c81494cc3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:37 devstack sudo[91843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1f2272-df07-47e3-aea9-036c81494cc3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d
Sep 16 21:54:37 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:37 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1f2272-df07-47e3-aea9-036c81494cc3 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d" returned: 0 in 0.367s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:37 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:37 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d
Sep 16 21:54:37 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-af1095e2-1b85-46bb-ac12-6edca70637d5-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-af1095e2-1b85-46bb-ac12-6edca70637d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-af1095e2-1b85-46bb-ac12-6edca70637d5" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-af1095e2-1b85-46bb-ac12-6edca70637d5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Deleting offline snapshot af1095e2-1b85-46bb-ac12-6edca70637d5 of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] snapshot_file for this snap is: volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055cda8-8a6b-4283-be64-f56974fe9529]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:38 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:38 devstack sudo[91855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info
Sep 16 21:54:38 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:38 devstack sudo[91854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:38 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:38 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:38 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:38 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info
Sep 16 21:54:38 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:38 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.602s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ba31a-ae17-4fcc-8ee2-5300e152819f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:38 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.info" returned: 0 in 0.347s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:38 devstack sudo[91864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:38 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2476fa14-109b-47f1-a4b0-5b31017ceaff tempest-GroupSnapshotsV319Test-246870821 None] group_snapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: created successfully
Sep 16 21:54:39 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.432s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:39 devstack sudo[91871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:39 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:39 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.558s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:39 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5
Sep 16 21:54:39 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Flow 'volume_create_manager' (d942e690-6ab5-4cf1-907a-65c04384f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dde142-1b6f-441d-a024-a1362af9163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] group_snapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: deleting
Sep 16 21:54:40 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dde142-1b6f-441d-a024-a1362af9163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-657971545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc53b84-555c-490e-8909-7392025dc3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f9a214855345f9895b5a5ed4bb538a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:40Z,use_quota=True,user_id='fd9cedce49e844958277df9a3685c583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cf9e0f-e24d-4a05-be48-6ca2d881d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cf9e0f-e24d-4a05-be48-6ca2d881d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24463653-9b2c-4d13-a5fd-80aed52301a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.af1095e2-1b85-46bb-ac12-6edca70637d5" returned: 0 in 0.350s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-af1095e2-1b85-46bb-ac12-6edca70637d5" released by "_delete_snapshot" :: held 2.088s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] group_snapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: deleting {{(pid=85936) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" released by "delete_snapshot" :: held 2.130s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "cinder-quobyte-0403b2e3-b233-45be-a48b-97320ee81b7d" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-0403b2e3-b233-45be-a48b-97320ee81b7d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Deleting offline snapshot 0403b2e3-b233-45be-a48b-97320ee81b7d of volume 7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] snapshot_file for this snap is: volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6ff3b-962b-46b5-81b9-09317c951836]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Created reservations ['d134a79f-3e78-422f-98f6-ed404f86709a', '0a474761-f7cd-4679-975d-4701e48ef561', 'aa75abec-8c56-4824-a894-cdb2e8196584', '99bacf90-3ff7-4838-85f6-ec711aaa754b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24463653-9b2c-4d13-a5fd-80aed52301a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cc53b84-555c-490e-8909-7392025dc3f4', 'volume_name': 'volume-1cc53b84-555c-490e-8909-7392025dc3f4', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afe989e0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7e509b-0964-4ad3-8628-2e0911342876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7e509b-0964-4ad3-8628-2e0911342876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:40 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d
Sep 16 21:54:40 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8117352-03f4-4d3e-bf3e-fbb0463708d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:40 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Volume 1cc53b84-555c-490e-8909-7392025dc3f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cc53b84-555c-490e-8909-7392025dc3f4', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afe989e0>}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Trying to clone 1cc53b84-555c-490e-8909-7392025dc3f4 from image b2c54ab4-3980-45cd-a037-6930dcd310de at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 21:54:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Delete snapshot completed successfully.
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cafc15aa-0734-47fc-8bb5-f8e35c81b9c2 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-af1095e2-1b85-46bb-ac12-6edca70637d5-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:40 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1f2272-df07-47e3-aea9-036c81494cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dc3fd8-2a8b-4a3f-a761-55452ddc4439]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 21:54:40 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf9e69-acc6-40f2-bf7f-ba7b75824b47]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:40 devstack sudo[91886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3
Sep 16 21:54:40 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:41 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD
Sep 16 21:54:41 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:41 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-287d5bff-0647-4742-8f6b-0187c99ada1b-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:41 devstack sudo[91894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d
Sep 16 21:54:41 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-287d5bff-0647-4742-8f6b-0187c99ada1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-287d5bff-0647-4742-8f6b-0187c99ada1b" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:41 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-287d5bff-0647-4742-8f6b-0187c99ada1b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Deleting offline snapshot 287d5bff-0647-4742-8f6b-0187c99ada1b of volume c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] snapshot_file for this snap is: volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de is fetched for user fd9cedce49e844958277df9a3685c583. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aa17df-b663-4a97-9c57-982dfa18c020]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84ada7b-94bc-4ba0-a2e6-2bd5ff26b6ea]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:41 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:41 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:41 devstack sudo[91900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD
Sep 16 21:54:41 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:41 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d" returned: 0 in 0.590s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:41 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d
Sep 16 21:54:41 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.495s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:54:42 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a135c-90d6-493a-bc30-bf95e69a940b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-657971545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc53b84-555c-490e-8909-7392025dc3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f9a214855345f9895b5a5ed4bb538a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:40Z,use_quota=True,user_id='fd9cedce49e844958277df9a3685c583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Creating volume 1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:42 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:42 devstack sudo[91917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1073741824
Sep 16 21:54:42 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3
Sep 16 21:54:42 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3.0403b2e3-b233-45be-a48b-97320ee81b7d" returned: 0 in 0.344s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-0403b2e3-b233-45be-a48b-97320ee81b7d" released by "_delete_snapshot" :: held 1.976s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" released by "delete_snapshot" :: held 2.023s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:42 devstack cinder-volume[85936]: WARNING cinder.quota [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-174380932 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-174380932, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:42 devstack cinder-volume[85936]: WARNING cinder.quota [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-174380932 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-174380932, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] Created reservations ['2925ef87-176e-42cb-91bf-ab5fa721bcda', '1a1a18ac-cac5-4e35-8f4f-08a69dbfd3ba', '86793a4e-3595-4195-a65b-d5a454c106f8', '26989635-23fa-4de0-b9a8-7ff2ceee55e9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:42 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" returned: 0 in 0.469s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3e70d1a2-8216-4883-82ba-d645062194ce tempest-GroupSnapshotsV319Test-246870821 None] group_snapshot ccbd7461-bd15-4edf-b81e-c72432cc2f0e: deleted successfully
Sep 16 21:54:42 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:42 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1073741824" returned: 0 in 0.541s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:42 devstack sudo[91930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4
Sep 16 21:54:42 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.362s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:42 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b
Sep 16 21:54:42 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:42 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4" returned: 0 in 0.278s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:42 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Attempting download of b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 1cc53b84-555c-490e-8909-7392025dc3f4. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8bdcfb-6b88-41e4-a406-783caf53a842]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:43 devstack sudo[91938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj
Sep 16 21:54:43 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:43 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3.287d5bff-0647-4742-8f6b-0187c99ada1b" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-287d5bff-0647-4742-8f6b-0187c99ada1b" released by "_delete_snapshot" :: held 1.822s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" released by "delete_snapshot" :: held 1.861s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Created reservations ['f187139b-fb78-4296-a243-008dbe9969f3', '66dcbfc2-80cc-4f69-92e0-f3d20d9ff5e3', '1b34de3e-2d34-49a1-917d-c54a99bb92af', '907b5aaf-6cf8-412f-a9e4-53dde087d52d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:43 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Delete snapshot completed successfully.
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4dadea3-a9f0-4dfc-9b9a-45794cd3229a tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-287d5bff-0647-4742-8f6b-0187c99ada1b-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:43 devstack sudo[91943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj
Sep 16 21:54:43 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:43 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj" returned: 1 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_qkr7nvkj' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[531b35d6-7997-468f-8b76-181ef9136ce1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" acquired by "delete_volume" :: waited 0.038s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ee315-0438-4925-bd96-f59d05c19821]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:44 devstack sudo[91947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD
Sep 16 21:54:44 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:54:44 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3
Sep 16 21:54:44 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" acquired by "delete_volume" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a85793-8ea6-4c70-bac2-17adeb8c0dfe]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:44 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] b2c54ab4-3980-45cd-a037-6930dcd310de was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:44 devstack sudo[91957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4
Sep 16 21:54:44 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack sudo[91952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3
Sep 16 21:54:44 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" returned: 0 in 0.560s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:44 devstack sudo[91963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3
Sep 16 21:54:44 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3" returned: 0 in 0.529s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:44 devstack sudo[91973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3
Sep 16 21:54:44 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:44 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" returned: 0 in 0.334s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-quobyte-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3" released by "delete_volume" :: held 1.048s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:44 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Created reservations ['4ca59b3c-78c6-419b-b059-55f96b133af5', '3b3d8a48-6bb8-4c11-a65e-9f2b537c082c', '62d9002b-6730-4df2-9843-76eef0a5c191', 'caa4fd6c-58fc-4fdf-b0d7-7aaede1c2ade'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:45 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7d1f2272-df07-47e3-aea9-036c81494cc3" returned: 0 in 0.336s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:45 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:45 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Lock "cinder-quobyte-7d1f2272-df07-47e3-aea9-036c81494cc3" released by "delete_volume" :: held 1.018s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Created reservations ['39353b12-9e55-45aa-a995-ebb30bfa073b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:45 devstack cinder-volume[85936]: WARNING cinder.quota [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-174380932 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-174380932, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Created reservations ['6baa6ec4-1758-498b-9c89-9888daf4c768', '224365db-523c-47f0-9236-aa9b95191724', '592abc82-2193-4c1d-8848-57d636ede7b3', 'eed2244a-10ff-4d8d-8ce4-0b7a804d9819'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:45 devstack sudo[91982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:54:45 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:45 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Deleted volume successfully.
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3a7d61e-328a-482c-a179-1161f93609f8 tempest-VolumesSnapshotListTestJSON-1091623863 None] Lock "cinder-c2fe4a0e-03d4-4ea6-8abd-df9d146dbde3-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:54:45 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:45 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:54:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b4572ffc-2b3b-4393-9b3f-f8fa5cac728d tempest-GroupSnapshotsV319Test-246870821 None] Delete group completed successfully.
Sep 16 21:54:46 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4" returned: 0 in 2.487s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:46 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_5a9dgcagdevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:54:46 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Converted 112.00 MB image at 44.98 MB/s
Sep 16 21:54:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:46 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1G
Sep 16 21:54:46 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:47 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 1G" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Downloaded image b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 1cc53b84-555c-490e-8909-7392025dc3f4 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de for user fd9cedce49e844958277df9a3685c583 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Marking volume 1cc53b84-555c-490e-8909-7392025dc3f4 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Copying metadata from image b2c54ab4-3980-45cd-a037-6930dcd310de to 1cc53b84-555c-490e-8909-7392025dc3f4. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Creating volume glance metadata for volume 1cc53b84-555c-490e-8909-7392025dc3f4 backed by image b2c54ab4-3980-45cd-a037-6930dcd310de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8117352-03f4-4d3e-bf3e-fbb0463708d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc53b84-555c-490e-8909-7392025dc3f4', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afe989e0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a209c9d-e888-48b9-9ff6-194a5b628535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:47 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Volume volume-1cc53b84-555c-490e-8909-7392025dc3f4 (1cc53b84-555c-490e-8909-7392025dc3f4): created successfully
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a209c9d-e888-48b9-9ff6-194a5b628535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Flow 'volume_create_manager' (d942e690-6ab5-4cf1-907a-65c04384f122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b1a0b4ba-c0b6-45e5-b369-dfcb9776d579 tempest-ServerActionsTestOtherA-564357530 None] Created volume successfully.
Sep 16 21:54:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa79edb1-06c6-4d2c-aa23-f47bca6744fd req-10056fb8-60a0-4b58-b10b-4ddc74542868 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa79edb1-06c6-4d2c-aa23-f47bca6744fd req-10056fb8-60a0-4b58-b10b-4ddc74542868 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa79edb1-06c6-4d2c-aa23-f47bca6744fd req-10056fb8-60a0-4b58-b10b-4ddc74542868 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:54:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Flow 'volume_create_manager' (d168cc2c-b5f3-4e28-b2f7-7bef7fdd9b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9627e88-cfd8-4413-a635-33e055da453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9627e88-cfd8-4413-a635-33e055da453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-211789375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c9156b-3923-438a-9520-ad664bf5ce8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1cc640c94c4c9da8d2f3ba4206ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:52Z,use_quota=True,user_id='7b6fea5345a243839fc304eee185158a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1735c-458e-4730-a4fb-3556539dfc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1735c-458e-4730-a4fb-3556539dfc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b54648-d725-4e4d-a288-56dbf17760c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b54648-d725-4e4d-a288-56dbf17760c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c9156b-3923-438a-9520-ad664bf5ce8b', 'volume_name': 'volume-06c9156b-3923-438a-9520-ad664bf5ce8b', 'volume_size': 2}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca204ca-24c6-4199-8d83-6c7d93f0c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca204ca-24c6-4199-8d83-6c7d93f0c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3b71b0-50a3-47a2-814f-7959a5a58b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Volume 06c9156b-3923-438a-9520-ad664bf5ce8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c9156b-3923-438a-9520-ad664bf5ce8b', 'volume_size': 2}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-211789375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c9156b-3923-438a-9520-ad664bf5ce8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee1cc640c94c4c9da8d2f3ba4206ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:54:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:54:52Z,use_quota=True,user_id='7b6fea5345a243839fc304eee185158a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Creating volume 06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:54:52 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b 2147483648 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:52 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b 2147483648
Sep 16 21:54:52 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-fa79edb1-06c6-4d2c-aa23-f47bca6744fd req-10056fb8-60a0-4b58-b10b-4ddc74542868 tempest-ServerActionsTestOtherA-564357530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-1cc53b84-555c-490e-8909-7392025dc3f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df0f266d-d4c6-4650-bdf3-edee6d7652fb', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:54:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-fa79edb1-06c6-4d2c-aa23-f47bca6744fd req-10056fb8-60a0-4b58-b10b-4ddc74542868 tempest-ServerActionsTestOtherA-564357530 None] attachment_update completed successfully.
Sep 16 21:54:52 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b 2147483648" returned: 0 in 0.831s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:53 devstack sudo[92032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b
Sep 16 21:54:53 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:53 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3b71b0-50a3-47a2-814f-7959a5a58b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c9156b-3923-438a-9520-ad664bf5ce8b', 'volume_size': 2}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ed1341-40b5-428d-bc5e-e205f81baeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:54:53 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Volume volume-06c9156b-3923-438a-9520-ad664bf5ce8b (06c9156b-3923-438a-9520-ad664bf5ce8b): created successfully
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ed1341-40b5-428d-bc5e-e205f81baeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:54:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Flow 'volume_create_manager' (d168cc2c-b5f3-4e28-b2f7-7bef7fdd9b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:54:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a6f6a83b-b756-4201-8e14-9ebff50c8d44 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Created volume successfully.
Sep 16 21:54:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:54:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:54:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Creating offline snapshot 49584ce7-3aed-4027-b78e-1bd62477679d of volume 06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:54:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4e672-2a23-4495-9733-005f359832c8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:54:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:54 devstack sudo[92039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b
Sep 16 21:54:54 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:55 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b" returned: 0 in 0.614s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d 2G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:55 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d 2G
Sep 16 21:54:55 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d 2G" returned: 0 in 0.706s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c9156b-3923-438a-9520-ad664bf5ce8b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:55 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:55 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c9156b-3923-438a-9520-ad664bf5ce8b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d
Sep 16 21:54:55 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:56 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c9156b-3923-438a-9520-ad664bf5ce8b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d" returned: 0 in 0.801s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:56 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d is being set with open permissions: ugo+rw
Sep 16 21:54:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:56 devstack sudo[92534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d
Sep 16 21:54:56 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:57 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d" returned: 0 in 0.600s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:57 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info
Sep 16 21:54:57 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:57 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info" returned: 0 in 0.616s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:57 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info is being set with open permissions: ugo+rw
Sep 16 21:54:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:54:58 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info
Sep 16 21:54:58 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:54:58 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Sep 16 21:54:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.info" returned: 0 in 0.638s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:54:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:54:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-44335d80-fdb0-4c06-ab89-625f9021e736 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Create snapshot completed successfully
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "cinder-49584ce7-3aed-4027-b78e-1bd62477679d-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-49584ce7-3aed-4027-b78e-1bd62477679d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "cinder-quobyte-49584ce7-3aed-4027-b78e-1bd62477679d" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-49584ce7-3aed-4027-b78e-1bd62477679d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Deleting offline snapshot 49584ce7-3aed-4027-b78e-1bd62477679d of volume 06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] snapshot_file for this snap is: volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c5c713-c8dc-4588-acf4-6279a82e050b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:00 devstack sudo[92582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d
Sep 16 21:55:00 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:01 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d" returned: 0 in 0.749s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c9156b-3923-438a-9520-ad664bf5ce8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:55:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9063abc6-385f-473a-96da-cc3b3194d910]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:01 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b
Sep 16 21:55:01 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:02 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b" returned: 0 in 0.982s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:02 devstack sudo[92596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d
Sep 16 21:55:02 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:03 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d" returned: 0 in 0.922s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:03 devstack sudo[92604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d
Sep 16 21:55:03 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:03 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b.49584ce7-3aed-4027-b78e-1bd62477679d" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-49584ce7-3aed-4027-b78e-1bd62477679d" released by "_delete_snapshot" :: held 3.259s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" released by "delete_snapshot" :: held 3.303s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Created reservations ['4d7ddc1a-9b16-49eb-a492-e0fa2b5a0bdc', 'e3a3f8b2-b992-4a3c-aeda-2680517d9a48', '6f81b90e-ac00-46c2-b560-1315a949a7df', 'fc1fa160-c527-4761-802b-171e2bb0617c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Delete snapshot completed successfully.
Sep 16 21:55:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5abb69c4-1929-4b4c-b4c9-7e8f1b609728 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-49584ce7-3aed-4027-b78e-1bd62477679d-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "cinder-06c9156b-3923-438a-9520-ad664bf5ce8b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-06c9156b-3923-438a-9520-ad664bf5ce8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" acquired by "delete_volume" :: waited 0.044s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d1f42-f99c-4a0d-9f18-00e2daa2bd05]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:05 devstack sudo[92610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b
Sep 16 21:55:05 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:06 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b" returned: 0 in 0.847s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:06 devstack sudo[92615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b
Sep 16 21:55:06 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:06 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-06c9156b-3923-438a-9520-ad664bf5ce8b" returned: 0 in 0.725s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-quobyte-06c9156b-3923-438a-9520-ad664bf5ce8b" released by "delete_volume" :: held 1.735s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Created reservations ['17a02d88-fa48-4da8-818b-b200c0d67482', 'a95a8f71-a057-40d2-91c3-af30c2c2a220', 'f9fcffda-cb28-4113-aac9-57bf27678955', '13303f71-bc37-4d70-b571-5550e67ee257'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:07 devstack sudo[92619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:07 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:07 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.627s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Deleted volume successfully.
Sep 16 21:55:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85d166cc-4d09-4501-b73d-66d1dab5a7f9 tempest-VolumesSnapshotNegativeTestJSON-1942341449 None] Lock "cinder-06c9156b-3923-438a-9520-ad664bf5ce8b-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:16 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=136,cinder:INSERT=39,cinder:UPDATE=127,cinder:DELETE=6 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:55:16 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=136,cinder:DELETE=9 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:55:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-a4bde9c3-bf57-4262-97c9-e3b8df900c9b tempest-ServerActionsTestOtherA-564357530 None] Terminate volume connection completed successfully.
Sep 16 21:55:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-a4bde9c3-bf57-4262-97c9-e3b8df900c9b tempest-ServerActionsTestOtherA-564357530 None] Deleting attachment df0f266d-d4c6-4650-bdf3-edee6d7652fb. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:55:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-9cb8808c-01a9-4851-86dd-5a642888d545 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-9cb8808c-01a9-4851-86dd-5a642888d545 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-9cb8808c-01a9-4851-86dd-5a642888d545 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-9cb8808c-01a9-4851-86dd-5a642888d545 tempest-ServerActionsTestOtherA-564357530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-1cc53b84-555c-490e-8909-7392025dc3f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27b0f152-5f1f-4e54-8742-46b07236a0fe', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:55:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-bf0dfc07-987b-4c6d-a346-56e020a35b0c req-9cb8808c-01a9-4851-86dd-5a642888d545 tempest-ServerActionsTestOtherA-564357530 None] attachment_update completed successfully.
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:22 devstack sudo[93590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:22 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:22 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:55:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:55:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (c82584f2-617f-4254-a525-06754f981eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899e9d9-8e9c-4fd4-80eb-ba0ef0b8fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1899e9d9-8e9c-4fd4-80eb-ba0ef0b8fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1548628696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f402a6-f284-4d33-8106-3546bc59bec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:25Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0246b7f3-65e4-481c-90e0-ead16faaac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0246b7f3-65e4-481c-90e0-ead16faaac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000898ad-24dd-4dc9-8ba6-69bc4c425ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000898ad-24dd-4dc9-8ba6-69bc4c425ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f402a6-f284-4d33-8106-3546bc59bec0', 'volume_name': 'volume-43f402a6-f284-4d33-8106-3546bc59bec0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b7dcb-3d5e-448c-b520-3eed7b203a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971b7dcb-3d5e-448c-b520-3eed7b203a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6c96ac-04b3-48f1-a1ec-08c24cbf1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Volume 43f402a6-f284-4d33-8106-3546bc59bec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f402a6-f284-4d33-8106-3546bc59bec0', 'volume_size': 1}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1548628696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f402a6-f284-4d33-8106-3546bc59bec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:25Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Creating volume 43f402a6-f284-4d33-8106-3546bc59bec0 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:25 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:25 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 1073741824
Sep 16 21:55:25 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:26 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 1073741824" returned: 0 in 0.734s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:26 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0
Sep 16 21:55:26 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:26 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6c96ac-04b3-48f1-a1ec-08c24cbf1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f402a6-f284-4d33-8106-3546bc59bec0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a5092-80fd-4ad0-a296-aa1c460398ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Volume volume-43f402a6-f284-4d33-8106-3546bc59bec0 (43f402a6-f284-4d33-8106-3546bc59bec0): created successfully
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69a5092-80fd-4ad0-a296-aa1c460398ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (c82584f2-617f-4254-a525-06754f981eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ec9a2ad5-1564-40c9-a1f3-e399e41d555c tempest-AttachVolumeTestJSON-1573343301 None] Created volume successfully.
Sep 16 21:55:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a9ec98d-205b-40db-8b14-0cd91e9320c6 req-f98bfe1e-d232-4945-8a0f-b568dfe9ac96 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a9ec98d-205b-40db-8b14-0cd91e9320c6 req-f98bfe1e-d232-4945-8a0f-b568dfe9ac96 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a9ec98d-205b-40db-8b14-0cd91e9320c6 req-f98bfe1e-d232-4945-8a0f-b568dfe9ac96 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-9a9ec98d-205b-40db-8b14-0cd91e9320c6 req-f98bfe1e-d232-4945-8a0f-b568dfe9ac96 tempest-AttachVolumeTestJSON-1573343301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-43f402a6-f284-4d33-8106-3546bc59bec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77393518-2421-48b4-a720-91afd07b5911', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:55:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-9a9ec98d-205b-40db-8b14-0cd91e9320c6 req-f98bfe1e-d232-4945-8a0f-b568dfe9ac96 tempest-AttachVolumeTestJSON-1573343301 None] attachment_update completed successfully.
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Flow 'volume_create_manager' (45262abf-350c-4c96-b142-c698bde6d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f32aea6-56e1-48a7-9488-38683b5a7678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f32aea6-56e1-48a7-9488-38683b5a7678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-468606867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be13535c-c311-436d-9a27-b92dc87d6135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073851e00da146fa9662b1ad1d362115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:37Z,use_quota=True,user_id='2eb8366480d241b480e7da2c9c0a0bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79167d23-437e-4e12-80c2-9e2b713fb35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79167d23-437e-4e12-80c2-9e2b713fb35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f541ac6-5329-4566-8f7c-591af126dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f541ac6-5329-4566-8f7c-591af126dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be13535c-c311-436d-9a27-b92dc87d6135', 'volume_name': 'volume-be13535c-c311-436d-9a27-b92dc87d6135', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1532515f-e5cf-49e8-be27-827285912725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1532515f-e5cf-49e8-be27-827285912725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a5b40e-25e3-409d-9f84-2047209a2cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume be13535c-c311-436d-9a27-b92dc87d6135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be13535c-c311-436d-9a27-b92dc87d6135', 'volume_size': 1}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-468606867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be13535c-c311-436d-9a27-b92dc87d6135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073851e00da146fa9662b1ad1d362115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:37Z,use_quota=True,user_id='2eb8366480d241b480e7da2c9c0a0bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Creating volume be13535c-c311-436d-9a27-b92dc87d6135 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:37 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:37 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 1073741824
Sep 16 21:55:37 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:38 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 1073741824" returned: 0 in 0.950s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:38 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135
Sep 16 21:55:38 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:38 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135" returned: 0 in 0.540s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a5b40e-25e3-409d-9f84-2047209a2cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be13535c-c311-436d-9a27-b92dc87d6135', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf641c-dd3b-40df-bbbf-572f86d2c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:38 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume volume-be13535c-c311-436d-9a27-b92dc87d6135 (be13535c-c311-436d-9a27-b92dc87d6135): created successfully
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf641c-dd3b-40df-bbbf-572f86d2c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Flow 'volume_create_manager' (45262abf-350c-4c96-b142-c698bde6d57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5368d8b0-a892-4273-99b3-cca94b38d222 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Created volume successfully.
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "cinder-be13535c-c311-436d-9a27-b92dc87d6135-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "cinder-be13535c-c311-436d-9a27-b92dc87d6135-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "cinder-quobyte-be13535c-c311-436d-9a27-b92dc87d6135" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "cinder-quobyte-be13535c-c311-436d-9a27-b92dc87d6135" acquired by "delete_volume" :: waited 0.046s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[700ff172-2156-4ad0-a99a-892e1264a687]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:40 devstack sudo[93810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135
Sep 16 21:55:40 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:40 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135" returned: 0 in 0.738s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:40 devstack sudo[93825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135
Sep 16 21:55:40 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:40 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-be13535c-c311-436d-9a27-b92dc87d6135" returned: 0 in 0.425s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "cinder-quobyte-be13535c-c311-436d-9a27-b92dc87d6135" released by "delete_volume" :: held 1.291s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:40 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Created reservations ['2602adf8-2646-44f3-8cb2-1b10ff725532', '8a6b7dd8-0c8a-42bf-ac5c-f35314fd2e15', '6e31317c-ac0d-4fed-a37d-1a90a32b2a04', '11901945-2cdf-445c-b38d-f763b5411936'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:41 devstack sudo[93829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:41 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:41 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.374s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Deleted volume successfully.
Sep 16 21:55:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f606c3b7-f4c4-46bb-bdeb-2cca745be723 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "cinder-be13535c-c311-436d-9a27-b92dc87d6135-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Flow 'volume_create_manager' (dd266e11-bd98-469c-bc9d-7e8186b5367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a76edbb-eec7-4e8b-abcb-d601ad9d6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a76edbb-eec7-4e8b-abcb-d601ad9d6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-104113839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ad688-f542-4801-995c-5c81c1974000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073851e00da146fa9662b1ad1d362115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:43Z,use_quota=True,user_id='2eb8366480d241b480e7da2c9c0a0bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5419109b-601f-4a37-9185-e4d43ad16793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5419109b-601f-4a37-9185-e4d43ad16793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36706ab2-840d-47ca-8d9b-b5d8cc9f161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36706ab2-840d-47ca-8d9b-b5d8cc9f161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3ad688-f542-4801-995c-5c81c1974000', 'volume_name': 'volume-ad3ad688-f542-4801-995c-5c81c1974000', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ba7ed3-714f-42a5-bcde-3c917306e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ba7ed3-714f-42a5-bcde-3c917306e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6b8b9-3a9f-43f0-b96d-abc30fe424b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume ad3ad688-f542-4801-995c-5c81c1974000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3ad688-f542-4801-995c-5c81c1974000', 'volume_size': 1}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-104113839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3ad688-f542-4801-995c-5c81c1974000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073851e00da146fa9662b1ad1d362115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:43Z,use_quota=True,user_id='2eb8366480d241b480e7da2c9c0a0bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Creating volume ad3ad688-f542-4801-995c-5c81c1974000 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:42 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:42 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 1073741824
Sep 16 21:55:42 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:43 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 1073741824" returned: 0 in 0.530s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:43 devstack sudo[93839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000
Sep 16 21:55:43 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:43 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6b8b9-3a9f-43f0-b96d-abc30fe424b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3ad688-f542-4801-995c-5c81c1974000', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53b9d8c-27ad-4b75-901a-459b20fd65af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Volume volume-ad3ad688-f542-4801-995c-5c81c1974000 (ad3ad688-f542-4801-995c-5c81c1974000): created successfully
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53b9d8c-27ad-4b75-901a-459b20fd65af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Flow 'volume_create_manager' (dd266e11-bd98-469c-bc9d-7e8186b5367d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-af1f921f-8845-456a-a92b-0a8a601e2e20 tempest-VolumeQuotasAdminTestJSON-1427596472 None] Created volume successfully.
Sep 16 21:55:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b636d6be-55cf-49ef-9713-42603a4a8c11 tempest-VolumeQuotasAdminTestJSON-141060912 None] Transfer volume completed successfully.
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Acquiring lock "cinder-ad3ad688-f542-4801-995c-5c81c1974000-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "cinder-ad3ad688-f542-4801-995c-5c81c1974000-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Acquiring lock "cinder-quobyte-ad3ad688-f542-4801-995c-5c81c1974000" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "cinder-quobyte-ad3ad688-f542-4801-995c-5c81c1974000" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4fa292-cd74-496e-a971-eb137757a4c5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:46 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000
Sep 16 21:55:46 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:46 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000" returned: 0 in 0.430s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:46 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000
Sep 16 21:55:46 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:47 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ad3ad688-f542-4801-995c-5c81c1974000" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "cinder-quobyte-ad3ad688-f542-4801-995c-5c81c1974000" released by "delete_volume" :: held 0.781s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Created reservations ['1e822ce9-bfdb-4e1f-bca5-18c99a3fe322', 'b71c27ce-9eb4-4ee5-81fa-0aa55854a4e8', '8c48d2a0-1281-4ca2-b5d3-e3dbba6caa11', 'db424574-053c-4231-a8f1-b50cab0c4242'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:47 devstack sudo[93857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:47 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:47 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.491s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Deleted volume successfully.
Sep 16 21:55:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6616fa7b-4337-4b84-a8a1-57d0a9e02422 tempest-VolumeQuotasAdminTestJSON-25263699 None] Lock "cinder-ad3ad688-f542-4801-995c-5c81c1974000-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (832ce03b-c682-4ad5-9684-87c830534672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78d1c30-1e84-4eb3-8867-e26f869338dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78d1c30-1e84-4eb3-8867-e26f869338dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1136302103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0a1619-a30f-41eb-9d4b-dda3377fa256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:50Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(712d864f-9d1a-443a-8643-a64a74e7d6fd),volume_type_id=712d864f-9d1a-443a-8643-a64a74e7d6fd)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befc1586-4d26-4a83-bd10-6f7f011e413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befc1586-4d26-4a83-bd10-6f7f011e413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773a124d-cadc-4c16-bdc9-49cd615d8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773a124d-cadc-4c16-bdc9-49cd615d8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed0a1619-a30f-41eb-9d4b-dda3377fa256', 'volume_name': 'volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11c7cb-7fb7-4c50-a974-ae6c3a9c3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11c7cb-7fb7-4c50-a974-ae6c3a9c3626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e748aa-7761-4671-8458-ed3081b9cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Volume ed0a1619-a30f-41eb-9d4b-dda3377fa256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256', 'volume_size': 1}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1136302103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0a1619-a30f-41eb-9d4b-dda3377fa256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:50Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(712d864f-9d1a-443a-8643-a64a74e7d6fd),volume_type_id=712d864f-9d1a-443a-8643-a64a74e7d6fd)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Creating volume ed0a1619-a30f-41eb-9d4b-dda3377fa256 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:50 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:50 devstack sudo[93860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 1073741824
Sep 16 21:55:50 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (9c00ddda-b8ea-4328-a28b-dc0cbb541370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2babc1-08ff-404b-be39-bb88092602ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2babc1-08ff-404b-be39-bb88092602ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-691917190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98ee9ce-4281-4184-9ee7-3b4a2b901f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:51Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fba9c210-0356-4aaf-8ca8-6eb3fb128ba0),volume_type_id=fba9c210-0356-4aaf-8ca8-6eb3fb128ba0)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72808f0-7e60-4edb-ba6c-d89287191153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72808f0-7e60-4edb-ba6c-d89287191153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bef7fe-ccd2-4a15-b956-925eeef34fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bef7fe-ccd2-4a15-b956-925eeef34fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98ee9ce-4281-4184-9ee7-3b4a2b901f89', 'volume_name': 'volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ba1703-7ba5-456d-b0b3-fdc31ef5d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ba1703-7ba5-456d-b0b3-fdc31ef5d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364224f9-3fc7-4d5c-b555-0e3e0b43dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Volume d98ee9ce-4281-4184-9ee7-3b4a2b901f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89', 'volume_size': 1}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:51 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 1073741824" returned: 0 in 0.960s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:51 devstack sudo[93867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256
Sep 16 21:55:51 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:51 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256" returned: 0 in 0.463s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-691917190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98ee9ce-4281-4184-9ee7-3b4a2b901f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:51Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fba9c210-0356-4aaf-8ca8-6eb3fb128ba0),volume_type_id=fba9c210-0356-4aaf-8ca8-6eb3fb128ba0)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Creating volume d98ee9ce-4281-4184-9ee7-3b4a2b901f89 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:51 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e748aa-7761-4671-8458-ed3081b9cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dff876-4511-461d-9593-56bc821b7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:51 devstack sudo[93872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 1073741824
Sep 16 21:55:51 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Volume volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 (ed0a1619-a30f-41eb-9d4b-dda3377fa256): created successfully
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dff876-4511-461d-9593-56bc821b7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (832ce03b-c682-4ad5-9684-87c830534672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (a0d8ca21-03c0-4ee1-b071-f8c52ae05ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3f4a93-5fee-4abf-9745-dfa16638aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-36239df8-942a-41a1-82b8-a65e1d777f1c tempest-TestInstancesWithCinderVolumes-251007304 None] Created volume successfully.
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3f4a93-5fee-4abf-9745-dfa16638aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-476642621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a25be85-b314-47f2-8be6-d6d0005781db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:52Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7460a63-6a41-45d5-be5c-a92a0f7e7138),volume_type_id=e7460a63-6a41-45d5-be5c-a92a0f7e7138)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aceedf-4324-4eac-ba32-974bc150be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91aceedf-4324-4eac-ba32-974bc150be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746d7bfe-1ec7-493e-87ed-e4b0a168486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 21:55:52 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 1073741824" returned: 0 in 0.592s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:52 devstack sudo[93879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89
Sep 16 21:55:52 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746d7bfe-1ec7-493e-87ed-e4b0a168486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a25be85-b314-47f2-8be6-d6d0005781db', 'volume_name': 'volume-4a25be85-b314-47f2-8be6-d6d0005781db', 'volume_size': 1, 'image_id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727149538', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b61aaa1ca1ae4210bae6ec516430fef2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'created_at': datetime.datetime(2026, 9, 16, 19, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afc8b710>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b11c0-08a2-46b2-9af4-4b11e04224e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b11c0-08a2-46b2-9af4-4b11e04224e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62604ec-d946-4493-8d3e-19f6dbf21897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Volume 4a25be85-b314-47f2-8be6-d6d0005781db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a25be85-b314-47f2-8be6-d6d0005781db', 'volume_size': 1, 'image_id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727149538', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b61aaa1ca1ae4210bae6ec516430fef2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'created_at': datetime.datetime(2026, 9, 16, 19, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afc8b710>}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Trying to clone 4a25be85-b314-47f2-8be6-d6d0005781db from image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 21:55:52 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" returned: 0 in 0.316s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364224f9-3fc7-4d5c-b555-0e3e0b43dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9395ff-dcfa-444b-b686-e2434db7a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Volume volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 (d98ee9ce-4281-4184-9ee7-3b4a2b901f89): created successfully
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9395ff-dcfa-444b-b686-e2434db7a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (9c00ddda-b8ea-4328-a28b-dc0cbb541370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f291f12d-dbc0-4bf0-8b47-ab687fe46b6f tempest-TestInstancesWithCinderVolumes-251007304 None] Created volume successfully.
Sep 16 21:55:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-655f250a-a3fd-484a-9e20-daa00129ca79 tempest-ServerActionsTestOtherA-564357530 None] Terminate volume connection completed successfully.
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-655f250a-a3fd-484a-9e20-daa00129ca79 tempest-ServerActionsTestOtherA-564357530 None] Deleting attachment 27b0f152-5f1f-4e54-8742-46b07236a0fe. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "cinder-1cc53b84-555c-490e-8909-7392025dc3f4-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-1cc53b84-555c-490e-8909-7392025dc3f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "cinder-quobyte-1cc53b84-555c-490e-8909-7392025dc3f4" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-quobyte-1cc53b84-555c-490e-8909-7392025dc3f4" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[29998846-d246-4638-8c3f-ce6aa10dae8b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:56 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4
Sep 16 21:55:56 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:56 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4" returned: 0 in 0.492s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:56 devstack sudo[93917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4
Sep 16 21:55:56 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:56 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD, size 20.69 MB, duration 4.36 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 21:55:56 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Image download 20.69 MB at 4.74 MB/s
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca162324-2670-4401-b14f-f4b65c891403]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:57 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1cc53b84-555c-490e-8909-7392025dc3f4" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:57 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD
Sep 16 21:55:57 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-quobyte-1cc53b84-555c-490e-8909-7392025dc3f4" released by "delete_volume" :: held 0.849s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.quota [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Created reservations ['d9e53719-3c1b-4029-bad3-e1eee89c4d05', 'ef2cf7f2-4758-4736-b248-cfd6bd9a9add', 'cd985efa-2b0e-4130-ab18-c91a7799030c', 'b0adca0c-b560-4056-be8e-27bb54c79895'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:57 devstack sudo[93922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:57 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:57 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Temporary image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf is fetched for user 1e68a162eb2e4769aeb91fee4f93e299. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5dfca-8694-443f-8e1f-c4980b144cd2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:57 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.263s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.manager [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:57 devstack sudo[93927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD
Sep 16 21:55:57 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Deleted volume successfully.
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-4ef2cb0b-412d-42cd-b76d-dd3a2de22298 req-ed7cf96c-5c24-479d-aca9-2670a6596ee3 tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-1cc53b84-555c-490e-8909-7392025dc3f4-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:55:57 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Flow 'volume_create_manager' (6ecb7d2c-ed95-4dbe-918c-b386e3755f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4622c180-1138-420c-bbef-a413b28f1540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "cinder-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-476642621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a25be85-b314-47f2-8be6-d6d0005781db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61aaa1ca1ae4210bae6ec516430fef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:52Z,use_quota=True,user_id='1e68a162eb2e4769aeb91fee4f93e299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7460a63-6a41-45d5-be5c-a92a0f7e7138),volume_type_id=e7460a63-6a41-45d5-be5c-a92a0f7e7138)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Creating volume 4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:57 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4622c180-1138-420c-bbef-a413b28f1540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1689292074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ad0963608f4cefb6328c5da8cf2b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:58Z,use_quota=True,user_id='5cf5a3910d094fd09a929b5717f51d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(151c6441-9c5a-4f07-a7af-1697e73cafbc),volume_type_id=151c6441-9c5a-4f07-a7af-1697e73cafbc)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:57 devstack sudo[93933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1073741824
Sep 16 21:55:57 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a57835-bd87-438f-bf9a-393de3d9c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a57835-bd87-438f-bf9a-393de3d9c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec19e335-2cac-48ed-9508-ce7a9faac35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec19e335-2cac-48ed-9508-ce7a9faac35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83', 'volume_name': 'volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0843826-2019-46a0-beb5-97975cf465f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0843826-2019-46a0-beb5-97975cf465f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82275a5-0ba6-4ee8-afde-de6ffd5d8074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:55:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Volume 9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83', 'volume_size': 1}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "cinder-quobyte-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-quobyte-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe4c1e-339c-47f9-8139-be47157aa2c0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555
Sep 16 21:55:58 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:58 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1073741824" returned: 0 in 0.456s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack sudo[93944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db
Sep 16 21:55:58 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:58 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack sudo[93946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555
Sep 16 21:55:58 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:58 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.677s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1689292074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51ad0963608f4cefb6328c5da8cf2b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:55:58Z,use_quota=True,user_id='5cf5a3910d094fd09a929b5717f51d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(151c6441-9c5a-4f07-a7af-1697e73cafbc),volume_type_id=151c6441-9c5a-4f07-a7af-1697e73cafbc)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Creating volume 9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:55:58 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" returned: 0 in 0.253s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:58 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 1073741824
Sep 16 21:55:58 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-quobyte-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555" released by "delete_volume" :: held 0.702s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Attempting download of a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}])) to volume 4a25be85-b314-47f2-8be6-d6d0005781db. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[022aae93-8333-4930-b937-32b2436c65ba]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Created reservations ['53d40315-3cad-4c47-b1a0-7577d917c448', '19a54b53-e4d4-4d58-b176-16d5c5774d98', 'b7fa0b1d-6c2b-4741-814a-43bb5449479d', '7f998a6c-297b-422a-af39-571637f75f9e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:55:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:58 devstack sudo[93952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm
Sep 16 21:55:58 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:59 devstack sudo[93955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:55:59 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:59 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:59 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm
Sep 16 21:55:59 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:59 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:59 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.441s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 1073741824" returned: 0 in 0.718s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:55:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Deleted volume successfully.
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bd3315ca-1a46-481d-9bfb-6bc639e58aae tempest-ServerActionsTestOtherA-564357530 None] Lock "cinder-00ddcaf3-aa7a-4158-a78a-a5ffdc84c555-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:59 devstack sudo[93968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83
Sep 16 21:55:59 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:55:59 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm" returned: 1 in 0.512s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_3617zukm' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391ca7c-2c4d-465d-9198-e3f1602a9180]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:55:59 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" returned: 0 in 0.497s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:55:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:00 devstack sudo[93981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD
Sep 16 21:56:00 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82275a5-0ba6-4ee8-afde-de6ffd5d8074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c56568-d378-4263-896d-c110a79b55e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:00 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Volume volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 (9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83): created successfully
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c56568-d378-4263-896d-c110a79b55e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Flow 'volume_create_manager' (6ecb7d2c-ed95-4dbe-918c-b386e3755f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-04028976-af4d-49b1-b0b5-2fcfa7080910 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Created volume successfully.
Sep 16 21:56:00 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 21:56:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:00 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db
Sep 16 21:56:00 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:01 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:56:01 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:02 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.313s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:02 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:56:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a68d1a80-09eb-4269-b30f-fb2a8893e684 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Retype volume completed successfully.
Sep 16 21:56:02 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db" returned: 0 in 2.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:02 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf_ievb5_r6devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:56:02 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Converted 112.00 MB image at 46.45 MB/s
Sep 16 21:56:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:02 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1G
Sep 16 21:56:02 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "cinder-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "cinder-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "cinder-quobyte-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "cinder-quobyte-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:03 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fec7d4-5c3f-411c-8c8b-579134d016da]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db 1G" returned: 0 in 0.500s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Downloaded image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}])) to volume 4a25be85-b314-47f2-8be6-d6d0005781db successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Temporary image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf for user 1e68a162eb2e4769aeb91fee4f93e299 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Marking volume 4a25be85-b314-47f2-8be6-d6d0005781db as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 21:56:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-68b736f1-c0c8-4821-b22d-df34e7982ddd req-af72c620-6713-4b36-bfc4-153c04f0025e tempest-AttachVolumeTestJSON-1573343301 None] Terminate volume connection completed successfully.
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-68b736f1-c0c8-4821-b22d-df34e7982ddd req-af72c620-6713-4b36-bfc4-153c04f0025e tempest-AttachVolumeTestJSON-1573343301 None] Deleting attachment 77393518-2421-48b4-a720-91afd07b5911. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Copying metadata from image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf to 4a25be85-b314-47f2-8be6-d6d0005781db. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Creating volume glance metadata for volume 4a25be85-b314-47f2-8be6-d6d0005781db backed by image a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf with: {'image_id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'image_name': 'tempest-scenario-img--1727149538', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62604ec-d946-4493-8d3e-19f6dbf21897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a25be85-b314-47f2-8be6-d6d0005781db', 'volume_size': 1, 'image_id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1727149538', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b61aaa1ca1ae4210bae6ec516430fef2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf', 'created_at': datetime.datetime(2026, 9, 16, 19, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9e20bd8-2c1f-468b-ac21-fbbc3ad68fbf/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afc8b710>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee5ebba-27b9-4dee-a800-f8b26446050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:03 devstack sudo[94033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83
Sep 16 21:56:03 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Volume volume-4a25be85-b314-47f2-8be6-d6d0005781db (4a25be85-b314-47f2-8be6-d6d0005781db): created successfully
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee5ebba-27b9-4dee-a800-f8b26446050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Flow 'volume_create_manager' (a0d8ca21-03c0-4ee1-b071-f8c52ae05ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-929645a7-a7b9-4ad2-8742-ffec58e24e0a tempest-TestInstancesWithCinderVolumes-251007304 None] Created volume successfully.
Sep 16 21:56:03 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:03 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83
Sep 16 21:56:03 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:03 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" returned: 0 in 0.300s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "cinder-quobyte-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83" released by "delete_volume" :: held 0.813s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:04 devstack cinder-volume[85936]: WARNING cinder.quota [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:56:04 devstack cinder-volume[85936]: WARNING cinder.quota [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Created reservations ['73d83b76-7c37-47e2-a2e9-f86a3856d6eb', 'b34f0590-d25a-4fa0-8cad-edc6313b2d43', '5d7c3817-0cb2-4527-b4f1-2f4677522f92', '287e49fe-e3e7-4651-9747-c2d9925747de'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:04 devstack sudo[94042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:56:04 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:04 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.312s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:56:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Deleted volume successfully.
Sep 16 21:56:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fac7dc0c-0f9a-4f88-a2e8-5a4116e19745 tempest-VolumeRetypeWithoutMigrationTest-1000615966 None] Lock "cinder-9bf5bdf4-3cc2-4b36-9c8f-d63d5b6a5a83-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6f392f45-aec0-40d6-8e94-d51b7711b28e req-7cec46ef-8b9a-4985-8493-f7941a9e30ce tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6f392f45-aec0-40d6-8e94-d51b7711b28e req-7cec46ef-8b9a-4985-8493-f7941a9e30ce tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6f392f45-aec0-40d6-8e94-d51b7711b28e req-7cec46ef-8b9a-4985-8493-f7941a9e30ce tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-6f392f45-aec0-40d6-8e94-d51b7711b28e req-7cec46ef-8b9a-4985-8493-f7941a9e30ce tempest-TestInstancesWithCinderVolumes-251007304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-4a25be85-b314-47f2-8be6-d6d0005781db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '428d3e47-e4af-45cc-9340-c6c467656ac6', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:56:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-6f392f45-aec0-40d6-8e94-d51b7711b28e req-7cec46ef-8b9a-4985-8493-f7941a9e30ce tempest-TestInstancesWithCinderVolumes-251007304 None] attachment_update completed successfully.
Sep 16 21:56:17 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=78,cinder:UPDATE=76,cinder:INSERT=17,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:56:17 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=70,cinder:UPDATE=68,cinder:DELETE=10,cinder:INSERT=19 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:22 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:56:22 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:22 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.808s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:56:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:56:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:56:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Flow 'volume_create_manager' (e78f3f7a-0123-48a6-ab6c-0a1e0ec8f617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0608a9-53b0-437a-b74c-a566bb7af721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0608a9-53b0-437a-b74c-a566bb7af721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1808258362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c879b43-01c5-4df6-a16d-0d061e1328a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64080704fef465e87879d710a0b8aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:56:25Z,use_quota=True,user_id='e6d88a3b38594fba86a5abe5ce104eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c72d98-0558-4099-b45e-3d2ff7cb9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c72d98-0558-4099-b45e-3d2ff7cb9a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90893662-6e03-4b14-8807-d21291c8c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:25 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 21:56:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90893662-6e03-4b14-8807-d21291c8c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c879b43-01c5-4df6-a16d-0d061e1328a9', 'volume_name': 'volume-2c879b43-01c5-4df6-a16d-0d061e1328a9', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afce9640>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd570808-fb52-4c57-a5b1-a37fd54c2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd570808-fb52-4c57-a5b1-a37fd54c2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91bcf5b-2711-42a3-b381-31af5184d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Volume 2c879b43-01c5-4df6-a16d-0d061e1328a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c879b43-01c5-4df6-a16d-0d061e1328a9', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afce9640>}
Sep 16 21:56:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Trying to clone 2c879b43-01c5-4df6-a16d-0d061e1328a9 from image b2c54ab4-3980-45cd-a037-6930dcd310de at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 21:56:27 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e97b1-bb40-45cb-95e7-641eabbca50e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:27 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD
Sep 16 21:56:27 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:27 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de is fetched for user e6d88a3b38594fba86a5abe5ce104eac. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f4186-5205-42f4-9531-3d38f7691a89]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:28 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD
Sep 16 21:56:28 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:28 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD" returned: 0 in 0.628s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1808258362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c879b43-01c5-4df6-a16d-0d061e1328a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64080704fef465e87879d710a0b8aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:56:25Z,use_quota=True,user_id='e6d88a3b38594fba86a5abe5ce104eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Creating volume 2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:56:28 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:56:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:28 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1073741824
Sep 16 21:56:28 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:29 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1073741824" returned: 0 in 0.698s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:29 devstack sudo[94676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9
Sep 16 21:56:29 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:29 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9" returned: 0 in 0.439s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:29 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Attempting download of b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 2c879b43-01c5-4df6-a16d-0d061e1328a9. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bcb9d4-063a-4eff-be6a-1e59eee3b8a6]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:30 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c
Sep 16 21:56:30 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:30 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c" returned: 0 in 0.382s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:30 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c
Sep 16 21:56:30 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:30 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c" returned: 1 in 0.525s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_huhgcq3c' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c038ee-2b85-48cd-81e2-8aa5bbf02755]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:31 devstack sudo[94687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD
Sep 16 21:56:31 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:31 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:31 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] b2c54ab4-3980-45cd-a037-6930dcd310de was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 21:56:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:31 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9
Sep 16 21:56:31 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:34 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9" returned: 0 in 2.905s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_4dzwgi3cdevstack@QuobyteHD, size 112.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:56:34 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Converted 112.00 MB image at 38.50 MB/s
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:34 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1G
Sep 16 21:56:34 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:34 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 1G" returned: 0 in 0.494s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Downloaded image b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 2c879b43-01c5-4df6-a16d-0d061e1328a9 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de for user e6d88a3b38594fba86a5abe5ce104eac is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 21:56:34 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Marking volume 2c879b43-01c5-4df6-a16d-0d061e1328a9 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Copying metadata from image b2c54ab4-3980-45cd-a037-6930dcd310de to 2c879b43-01c5-4df6-a16d-0d061e1328a9. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Creating volume glance metadata for volume 2c879b43-01c5-4df6-a16d-0d061e1328a9 backed by image b2c54ab4-3980-45cd-a037-6930dcd310de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91bcf5b-2711-42a3-b381-31af5184d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c879b43-01c5-4df6-a16d-0d061e1328a9', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afce9640>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b567a327-37b3-4751-a539-d8c80612d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Volume volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 (2c879b43-01c5-4df6-a16d-0d061e1328a9): created successfully
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b567a327-37b3-4751-a539-d8c80612d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Flow 'volume_create_manager' (e78f3f7a-0123-48a6-ab6c-0a1e0ec8f617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-99dd8255-c1cc-4804-898b-3f9d4ef24860 tempest-VolumesImageMetadata-77752176 None] Created volume successfully.
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Acquiring lock "cinder-2c879b43-01c5-4df6-a16d-0d061e1328a9-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "cinder-2c879b43-01c5-4df6-a16d-0d061e1328a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Acquiring lock "cinder-quobyte-2c879b43-01c5-4df6-a16d-0d061e1328a9" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "cinder-quobyte-2c879b43-01c5-4df6-a16d-0d061e1328a9" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92be66-982e-4971-9870-c414c0592bae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:36 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9
Sep 16 21:56:36 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:37 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:37 devstack sudo[94779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9
Sep 16 21:56:37 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:37 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2c879b43-01c5-4df6-a16d-0d061e1328a9" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "cinder-quobyte-2c879b43-01c5-4df6-a16d-0d061e1328a9" released by "delete_volume" :: held 0.859s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Created reservations ['50baf958-8c73-4416-aa48-3a15c81b1ea1', '7bfa7d43-277b-4e61-8443-3e60368c1e5b', '4b42fe21-de19-4077-9b69-679bd5a72f1e', '5249a7f5-c89b-45a4-b00a-30b159949d69'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:37 devstack sudo[94787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:56:37 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:38 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:38 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:56:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Deleted volume successfully.
Sep 16 21:56:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-db89d775-9d7e-4f38-88e3-9b1c920a6148 tempest-VolumesImageMetadata-77752176 None] Lock "cinder-2c879b43-01c5-4df6-a16d-0d061e1328a9-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Flow 'volume_create_manager' (19d69ad9-b5f0-4583-bccc-3275790037ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c6009-5c4d-4441-8ac2-b54ef33858c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88c6009-5c4d-4441-8ac2-b54ef33858c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1430121243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74b8ee-e2e0-48fb-843e-79cab87f9edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46b1267cf7e476c996036103b96916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:56:43Z,use_quota=True,user_id='a70629f28a104939a3a0b4672b9846f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbecd5db-c137-4913-8ad0-8a0c7a73979a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbecd5db-c137-4913-8ad0-8a0c7a73979a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb35f4e-6a5d-4ab3-a49c-a5a7f31dbd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb35f4e-6a5d-4ab3-a49c-a5a7f31dbd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf74b8ee-e2e0-48fb-843e-79cab87f9edf', 'volume_name': 'volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48a2eaa-2217-4d2e-a2ac-2c3387e0858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48a2eaa-2217-4d2e-a2ac-2c3387e0858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f481e3-48cf-427f-b54f-615258c563b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Volume bf74b8ee-e2e0-48fb-843e-79cab87f9edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf', 'volume_size': 1}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1430121243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74b8ee-e2e0-48fb-843e-79cab87f9edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46b1267cf7e476c996036103b96916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:56:43Z,use_quota=True,user_id='a70629f28a104939a3a0b4672b9846f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Creating volume bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:56:43 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:56:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:43 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf 1073741824
Sep 16 21:56:43 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:44 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf 1073741824" returned: 0 in 0.715s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:44 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf
Sep 16 21:56:44 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:44 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" returned: 0 in 0.508s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f481e3-48cf-427f-b54f-615258c563b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a5102f-4745-4002-a0c6-d937569f921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:56:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Volume volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf (bf74b8ee-e2e0-48fb-843e-79cab87f9edf): created successfully
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a5102f-4745-4002-a0c6-d937569f921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:56:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Flow 'volume_create_manager' (19d69ad9-b5f0-4583-bccc-3275790037ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:56:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-32c22f6c-8f0b-4f83-bb17-fdaff624b97e tempest-SnapshotMetadataTestJSON-1884865209 None] Created volume successfully.
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Creating offline snapshot 370f1407-2e58-4bd1-9ed5-97907e1267da of volume bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfe7774-dd23-4a7a-96b1-0952e13aa294]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:46 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf
Sep 16 21:56:46 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:46 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" returned: 0 in 0.665s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:46 devstack sudo[94946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da 1G
Sep 16 21:56:46 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:47 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da 1G" returned: 0 in 0.837s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:47 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da
Sep 16 21:56:47 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:48 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da" returned: 0 in 0.732s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:48 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da is being set with open permissions: ugo+rw
Sep 16 21:56:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:48 devstack sudo[94991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da
Sep 16 21:56:48 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6b581b35-b4b9-4225-b1c5-02415f3eff94 req-697c9acb-f625-47c8-9cbf-f087fef7b87c tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:48 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:48 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info
Sep 16 21:56:48 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:49 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info" returned: 0 in 0.350s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:49 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info is being set with open permissions: ugo+rw
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:49 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info
Sep 16 21:56:49 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:49 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.info" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6b581b35-b4b9-4225-b1c5-02415f3eff94 req-697c9acb-f625-47c8-9cbf-f087fef7b87c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.904s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6b581b35-b4b9-4225-b1c5-02415f3eff94 req-697c9acb-f625-47c8-9cbf-f087fef7b87c tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dd89fb9d-92fe-45cc-9000-aa61f954ccc5 tempest-SnapshotMetadataTestJSON-1884865209 None] Create snapshot completed successfully
Sep 16 21:56:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-6b581b35-b4b9-4225-b1c5-02415f3eff94 req-697c9acb-f625-47c8-9cbf-f087fef7b87c tempest-TestInstancesWithCinderVolumes-251007304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b8335b7-53b3-48d2-9744-41976617cdcc', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:56:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-6b581b35-b4b9-4225-b1c5-02415f3eff94 req-697c9acb-f625-47c8-9cbf-f087fef7b87c tempest-TestInstancesWithCinderVolumes-251007304 None] attachment_update completed successfully.
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "cinder-370f1407-2e58-4bd1-9ed5-97907e1267da-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-370f1407-2e58-4bd1-9ed5-97907e1267da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "cinder-quobyte-370f1407-2e58-4bd1-9ed5-97907e1267da" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-370f1407-2e58-4bd1-9ed5-97907e1267da" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Deleting offline snapshot 370f1407-2e58-4bd1-9ed5-97907e1267da of volume bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] snapshot_file for this snap is: volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b5d2d-c7f1-43fd-9083-bb9c58d2364b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:52 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da
Sep 16 21:56:52 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:52 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da" returned: 0 in 1.011s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:56:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef75839-0a23-48bb-be40-dacc27b7f249]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:53 devstack sudo[95087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf
Sep 16 21:56:53 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:53 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" returned: 0 in 0.568s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:53 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da
Sep 16 21:56:53 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6e9ea7d5-809c-47fe-969c-fb18c4fe6881 req-87b05b3a-d279-48a3-9697-80be40cb3df5 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6e9ea7d5-809c-47fe-969c-fb18c4fe6881 req-87b05b3a-d279-48a3-9697-80be40cb3df5 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-6e9ea7d5-809c-47fe-969c-fb18c4fe6881 req-87b05b3a-d279-48a3-9697-80be40cb3df5 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-6e9ea7d5-809c-47fe-969c-fb18c4fe6881 req-87b05b3a-d279-48a3-9697-80be40cb3df5 tempest-TestInstancesWithCinderVolumes-251007304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66739f0c-6886-4dce-8dce-67e8a7729374', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:56:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-6e9ea7d5-809c-47fe-969c-fb18c4fe6881 req-87b05b3a-d279-48a3-9697-80be40cb3df5 tempest-TestInstancesWithCinderVolumes-251007304 None] attachment_update completed successfully.
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da" returned: 0 in 0.637s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:54 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:54 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da
Sep 16 21:56:54 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:54 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf.370f1407-2e58-4bd1-9ed5-97907e1267da" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-370f1407-2e58-4bd1-9ed5-97907e1267da" released by "_delete_snapshot" :: held 2.859s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" released by "delete_snapshot" :: held 2.936s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Created reservations ['a5dffa64-dae0-44ec-96a9-1d02a9fcdfd0', 'ab123645-33d2-4f88-94a5-fd935f47a12f', '9adb02e4-12c3-4c07-95ab-be69c03f348a', 'cbb8dc3a-7574-4c5a-b743-05ed6e456b10'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:56:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Delete snapshot completed successfully.
Sep 16 21:56:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-71b81c13-af22-49a4-a4f2-845ddd6d28cb tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-370f1407-2e58-4bd1-9ed5-97907e1267da-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "cinder-bf74b8ee-e2e0-48fb-843e-79cab87f9edf-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-bf74b8ee-e2e0-48fb-843e-79cab87f9edf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6dd9b-e74b-4329-933d-22b3bf179792]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:56:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:55 devstack sudo[95114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf
Sep 16 21:56:55 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:56 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" returned: 0 in 0.651s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:56 devstack sudo[95127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf
Sep 16 21:56:56 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:56 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-quobyte-bf74b8ee-e2e0-48fb-843e-79cab87f9edf" released by "delete_volume" :: held 1.117s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Created reservations ['a2406dfc-411c-4d3b-8295-95550a928b7f', 'a32485c0-4abe-4038-9570-3bb49946dcc3', 'fec3f32d-5be3-478a-ab8b-1d7f4641e3f1', '2a7398fe-677d-4cb5-ab83-000282e74718'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:56:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:56:56 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:56:56 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:56:57 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Sep 16 21:56:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.447s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:56:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:56:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Deleted volume successfully.
Sep 16 21:56:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-16c9ee1d-244c-46d2-9acc-72b296ca6920 tempest-SnapshotMetadataTestJSON-1884865209 None] Lock "cinder-bf74b8ee-e2e0-48fb-843e-79cab87f9edf-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-225ac4c0-3e37-4bae-b88a-50b043be0e68 req-07d0a3a4-85d1-4de1-87aa-0a09bc4bc23b tempest-TestInstancesWithCinderVolumes-251007304 None] Terminate volume connection completed successfully.
Sep 16 21:57:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-225ac4c0-3e37-4bae-b88a-50b043be0e68 req-07d0a3a4-85d1-4de1-87aa-0a09bc4bc23b tempest-TestInstancesWithCinderVolumes-251007304 None] Deleting attachment 4b8335b7-53b3-48d2-9744-41976617cdcc. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-ed0a1619-a30f-41eb-9d4b-dda3377fa256-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-ed0a1619-a30f-41eb-9d4b-dda3377fa256-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-quobyte-ed0a1619-a30f-41eb-9d4b-dda3377fa256" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-ed0a1619-a30f-41eb-9d4b-dda3377fa256" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66d1fb9-27b2-42c3-b83a-7bf0fdbacb93]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:01 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256
Sep 16 21:57:01 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:02 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256" returned: 0 in 0.421s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:02 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256
Sep 16 21:57:02 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:02 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ed0a1619-a30f-41eb-9d4b-dda3377fa256" returned: 0 in 0.293s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-ed0a1619-a30f-41eb-9d4b-dda3377fa256" released by "delete_volume" :: held 0.784s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:02 devstack cinder-volume[85936]: WARNING cinder.quota [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1069670751-260116797 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1069670751-260116797, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:02 devstack cinder-volume[85936]: WARNING cinder.quota [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1069670751-260116797 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1069670751-260116797, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Created reservations ['30817689-2a8c-41fd-9614-4ea41e96e372', '0ce71304-6ab1-48aa-afd3-167cc6b3c99a', '85a1154c-7ed4-46f8-bab3-2b2f3f90afbf', '2671738f-6c81-445f-a7de-a6051f58bb47'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:02 devstack sudo[95193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:02 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:03 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.388s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Deleted volume successfully.
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb5d0032-18dc-42ff-83a3-df09de2ef952 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-ed0a1619-a30f-41eb-9d4b-dda3377fa256-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Flow 'volume_create_manager' (1ecf1261-8e3d-433a-9b87-47aa6525b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb7bce5-c26d-4c3e-a951-09163c8d7689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb7bce5-c26d-4c3e-a951-09163c8d7689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1827944993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa62c49-0dc0-4568-b805-1342e7fdff55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='586808df27f94922b415d30dc1cd64de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:03Z,use_quota=True,user_id='08264c61c73e47cc8d25737bf9d4e417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba36a462-8b98-4b98-8ecf-4e4d061dd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba36a462-8b98-4b98-8ecf-4e4d061dd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb916ef-b259-4aa8-af3e-31db6513891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb916ef-b259-4aa8-af3e-31db6513891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa62c49-0dc0-4568-b805-1342e7fdff55', 'volume_name': 'volume-afa62c49-0dc0-4568-b805-1342e7fdff55', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b046333-c230-431a-9b90-b7ac729bf7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b046333-c230-431a-9b90-b7ac729bf7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643bd0b-24da-441c-be48-99e99a4feaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Volume afa62c49-0dc0-4568-b805-1342e7fdff55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa62c49-0dc0-4568-b805-1342e7fdff55', 'volume_size': 1}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1827944993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa62c49-0dc0-4568-b805-1342e7fdff55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='586808df27f94922b415d30dc1cd64de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:03Z,use_quota=True,user_id='08264c61c73e47cc8d25737bf9d4e417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Creating volume afa62c49-0dc0-4568-b805-1342e7fdff55 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:03 devstack sudo[95196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 1073741824
Sep 16 21:57:03 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:03 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 1073741824" returned: 0 in 0.500s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:03 devstack sudo[95202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55
Sep 16 21:57:03 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:04 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0643bd0b-24da-441c-be48-99e99a4feaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa62c49-0dc0-4568-b805-1342e7fdff55', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f811dcd4-8916-4e1a-b09c-81a59c69ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Volume volume-afa62c49-0dc0-4568-b805-1342e7fdff55 (afa62c49-0dc0-4568-b805-1342e7fdff55): created successfully
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f811dcd4-8916-4e1a-b09c-81a59c69ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Flow 'volume_create_manager' (1ecf1261-8e3d-433a-9b87-47aa6525b073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0bbe3e8f-ec56-4752-8fef-2484dcb10b12 tempest-AbsoluteLimitsTests-889201988 None] Created volume successfully.
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Acquiring lock "cinder-afa62c49-0dc0-4568-b805-1342e7fdff55-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "cinder-afa62c49-0dc0-4568-b805-1342e7fdff55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Acquiring lock "cinder-quobyte-afa62c49-0dc0-4568-b805-1342e7fdff55" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "cinder-quobyte-afa62c49-0dc0-4568-b805-1342e7fdff55" acquired by "delete_volume" :: waited 0.045s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9fc997-2f42-4b4d-8e9a-691aa867e9ca]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:05 devstack sudo[95227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55
Sep 16 21:57:05 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:06 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55" returned: 0 in 0.501s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:06 devstack sudo[95235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55
Sep 16 21:57:06 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:06 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-2bc6bfca-ed2d-45ae-a0e4-b12ca9b1bb04 req-50e70d39-229e-4b91-9988-6a557c4b76e4 tempest-TestInstancesWithCinderVolumes-251007304 None] Terminate volume connection completed successfully.
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-2bc6bfca-ed2d-45ae-a0e4-b12ca9b1bb04 req-50e70d39-229e-4b91-9988-6a557c4b76e4 tempest-TestInstancesWithCinderVolumes-251007304 None] Deleting attachment 66739f0c-6886-4dce-8dce-67e8a7729374. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:06 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-afa62c49-0dc0-4568-b805-1342e7fdff55" returned: 0 in 0.330s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "cinder-quobyte-afa62c49-0dc0-4568-b805-1342e7fdff55" released by "delete_volume" :: held 0.894s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Created reservations ['9a26c911-4bc7-4884-8d51-3ac1fc0aab5a', '30056942-0858-480a-8e2b-6d08a14b6a03', '3872217b-a6a2-4317-bee2-5858334f847c', '8fffd58b-073e-41a6-af33-d12f48025aaa'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:06 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:06 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-d98ee9ce-4281-4184-9ee7-3b4a2b901f89-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-d98ee9ce-4281-4184-9ee7-3b4a2b901f89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-quobyte-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" acquired by "delete_volume" :: waited 0.054s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c59c09-33c1-4989-96ac-75e75cc33a7d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:07 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.543s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Deleted volume successfully.
Sep 16 21:57:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d2eca2a7-dba4-49d5-8bc7-c3b10184087a tempest-AbsoluteLimitsTests-889201988 None] Lock "cinder-afa62c49-0dc0-4568-b805-1342e7fdff55-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:07 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89
Sep 16 21:57:07 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:08 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" returned: 0 in 0.739s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:08 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89
Sep 16 21:57:08 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (de53a8bb-310d-4410-b17d-02de216e58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312c80d5-a5ac-4c8f-8357-d3a3a55d8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312c80d5-a5ac-4c8f-8357-d3a3a55d8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-185362158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25d087-ee60-49c3-b6a6-9b603cab308c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:08Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b596b-4ec1-43eb-bcf5-35fd50244b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b596b-4ec1-43eb-bcf5-35fd50244b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c2a260-0efa-4e6a-ae0b-7853c10b6ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c2a260-0efa-4e6a-ae0b-7853c10b6ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f25d087-ee60-49c3-b6a6-9b603cab308c', 'volume_name': 'volume-9f25d087-ee60-49c3-b6a6-9b603cab308c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f229ba-4a3c-48ac-8bd6-bcb555e26ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f229ba-4a3c-48ac-8bd6-bcb555e26ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbea4df8-a6b5-4c8f-aaac-9bed55f380fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Volume 9f25d087-ee60-49c3-b6a6-9b603cab308c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f25d087-ee60-49c3-b6a6-9b603cab308c', 'volume_size': 1}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-185362158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25d087-ee60-49c3-b6a6-9b603cab308c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:08Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Creating volume 9f25d087-ee60-49c3-b6a6-9b603cab308c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:08 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:08 devstack sudo[95275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c 1073741824
Sep 16 21:57:08 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:08 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-d98ee9ce-4281-4184-9ee7-3b4a2b901f89" released by "delete_volume" :: held 1.181s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:08 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643503192-416694225 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643503192-416694225, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:08 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643503192-416694225 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1643503192-416694225, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Created reservations ['94de53f9-7792-4247-84c7-fb2bbcb283ef', '3b032b8b-9d6c-46e3-a4c3-1a037ab2a74f', 'ba73b9cd-07e2-4dd9-ae8c-e9e39ddb25b0', 'd17b4f5f-b03c-4df6-9168-d4c740c39a1c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:08 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:08 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:08 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c 1073741824" returned: 0 in 0.596s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:08 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Deleted volume successfully.
Sep 16 21:57:08 devstack sudo[95285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c
Sep 16 21:57:08 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1b1e4579-ee16-4bb5-823d-70ad68db8aa3 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-d98ee9ce-4281-4184-9ee7-3b4a2b901f89-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:09 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c" returned: 0 in 0.322s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbea4df8-a6b5-4c8f-aaac-9bed55f380fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f25d087-ee60-49c3-b6a6-9b603cab308c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f596364a-c746-40bc-bb3a-cd76c8834080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Volume volume-9f25d087-ee60-49c3-b6a6-9b603cab308c (9f25d087-ee60-49c3-b6a6-9b603cab308c): created successfully
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f596364a-c746-40bc-bb3a-cd76c8834080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (de53a8bb-310d-4410-b17d-02de216e58ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bbb23a3a-5749-4ad8-83f3-1aca606d36f3 tempest-AttachVolumeNegativeTest-384733218 None] Created volume successfully.
Sep 16 21:57:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-226459db-dd68-4a5a-abae-1a50a82ad3aa req-ce7449b0-d3b7-4619-a1c7-ce2fbfd1e465 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-226459db-dd68-4a5a-abae-1a50a82ad3aa req-ce7449b0-d3b7-4619-a1c7-ce2fbfd1e465 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-226459db-dd68-4a5a-abae-1a50a82ad3aa req-ce7449b0-d3b7-4619-a1c7-ce2fbfd1e465 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-226459db-dd68-4a5a-abae-1a50a82ad3aa req-ce7449b0-d3b7-4619-a1c7-ce2fbfd1e465 tempest-AttachVolumeNegativeTest-384733218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-9f25d087-ee60-49c3-b6a6-9b603cab308c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cad003b8-f5c2-47f1-bb66-ebdf323f04b4', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:57:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-226459db-dd68-4a5a-abae-1a50a82ad3aa req-ce7449b0-d3b7-4619-a1c7-ce2fbfd1e465 tempest-AttachVolumeNegativeTest-384733218 None] attachment_update completed successfully.
Sep 16 21:57:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-75970f95-82d1-4167-a9c9-f31dfa9e862d req-deddf72c-860b-4720-b3ca-392bfd43de05 tempest-TestInstancesWithCinderVolumes-251007304 None] Terminate volume connection completed successfully.
Sep 16 21:57:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-75970f95-82d1-4167-a9c9-f31dfa9e862d req-deddf72c-860b-4720-b3ca-392bfd43de05 tempest-TestInstancesWithCinderVolumes-251007304 None] Deleting attachment 428d3e47-e4af-45cc-9340-c6c467656ac6. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-4a25be85-b314-47f2-8be6-d6d0005781db-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-4a25be85-b314-47f2-8be6-d6d0005781db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "cinder-quobyte-4a25be85-b314-47f2-8be6-d6d0005781db" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-4a25be85-b314-47f2-8be6-d6d0005781db" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7788c9-0720-4099-a424-60b2b55bc0b5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:13 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db
Sep 16 21:57:13 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:13 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:13 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db
Sep 16 21:57:13 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (821b4479-9196-4381-a62f-615618093aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac79497-37be-4b72-b72c-57acd9081d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac79497-37be-4b72-b72c-57acd9081d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2072578495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d85679-533a-44ff-aeb0-e3cdf034d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1dcfa55b68456dbe202d69329470f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:14Z,use_quota=True,user_id='2632f213efc84327a105cbc3f559ae25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b800007-9653-44c6-be4e-ef4ac92c9cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b800007-9653-44c6-be4e-ef4ac92c9cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4813a32c-4439-46e7-ae08-5f549290e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4813a32c-4439-46e7-ae08-5f549290e75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d85679-533a-44ff-aeb0-e3cdf034d119', 'volume_name': 'volume-a5d85679-533a-44ff-aeb0-e3cdf034d119', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93865fd2-6f97-4e16-bf61-636fcaf96b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93865fd2-6f97-4e16-bf61-636fcaf96b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6de277-541e-47e5-ad27-15a7287b273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Volume a5d85679-533a-44ff-aeb0-e3cdf034d119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d85679-533a-44ff-aeb0-e3cdf034d119', 'volume_size': 1}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2072578495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d85679-533a-44ff-aeb0-e3cdf034d119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1dcfa55b68456dbe202d69329470f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:14Z,use_quota=True,user_id='2632f213efc84327a105cbc3f559ae25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Creating volume a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:14 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a25be85-b314-47f2-8be6-d6d0005781db" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-quobyte-4a25be85-b314-47f2-8be6-d6d0005781db" released by "delete_volume" :: held 0.773s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:14 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 1073741824
Sep 16 21:57:14 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:14 devstack cinder-volume[85936]: WARNING cinder.quota [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7080505-904062695 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7080505-904062695, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:14 devstack cinder-volume[85936]: WARNING cinder.quota [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7080505-904062695 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-7080505-904062695, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Created reservations ['35bbbb9b-679c-4fce-a97e-d641da42fd85', 'ea1732fb-43da-46f0-8ecd-c06a9f9c7f36', 'ae8f4f9f-5274-484f-b9f7-c17b5c78a56e', '70e0876b-5e78-4013-8314-4d50186f243b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:14 devstack sudo[95749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:14 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:14 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.308s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Deleted volume successfully.
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f97060cb-54e5-4511-b484-b46c44f68887 tempest-TestInstancesWithCinderVolumes-251007304 None] Lock "cinder-4a25be85-b314-47f2-8be6-d6d0005781db-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:14 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 1073741824" returned: 0 in 0.683s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:14 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119
Sep 16 21:57:14 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:15 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6de277-541e-47e5-ad27-15a7287b273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d85679-533a-44ff-aeb0-e3cdf034d119', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9318fcd1-329d-41b2-ac4c-8547f171e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Volume volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 (a5d85679-533a-44ff-aeb0-e3cdf034d119): created successfully
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9318fcd1-329d-41b2-ac4c-8547f171e706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (821b4479-9196-4381-a62f-615618093aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-129fdba0-d15f-47e6-8e63-af0fcf7bc1c1 tempest-VolumesDeleteCascade-717720401 None] Created volume successfully.
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Creating offline snapshot b23451d1-f73e-411e-ad30-ab01a46edd7f of volume a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6392c4-b446-41f4-9b52-af6a4b75aecf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:16 devstack sudo[95759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119
Sep 16 21:57:16 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:16 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:16 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f 1G
Sep 16 21:57:16 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:17 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f 1G" returned: 0 in 0.590s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:17 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:17 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:17 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.400s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:17 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f is being set with open permissions: ugo+rw
Sep 16 21:57:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:17 devstack sudo[95784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:17 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:18 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=83,cinder:SELECT=84,cinder:INSERT=22,cinder:DELETE=7 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.532s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=78,cinder:INSERT=25,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (c844ec3b-2e3a-4ddf-82ff-3359f5172b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b18fff5-188d-4fd3-a7cf-be020596770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b18fff5-188d-4fd3-a7cf-be020596770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1315000548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ef76b-7ba6-4cfe-bafc-490d85a645a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:18Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d468ad60-e40b-4398-966c-6cb89bb1c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d468ad60-e40b-4398-966c-6cb89bb1c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9d4fc6-b315-4f7d-a17b-495b089d9d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9d4fc6-b315-4f7d-a17b-495b089d9d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56ef76b-7ba6-4cfe-bafc-490d85a645a9', 'volume_name': 'volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25322c8d-604b-413f-ad2d-dea51d3a1dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25322c8d-604b-413f-ad2d-dea51d3a1dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fc370b-0ba0-479a-893d-2b9ee716edfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Volume a56ef76b-7ba6-4cfe-bafc-490d85a645a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9', 'volume_size': 1}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:18 devstack sudo[95790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info
Sep 16 21:57:18 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:18 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:18 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info is being set with open permissions: ugo+rw
Sep 16 21:57:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:18 devstack sudo[95801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info
Sep 16 21:57:18 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:19 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.info" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1315000548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56ef76b-7ba6-4cfe-bafc-490d85a645a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:18Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Creating volume a56ef76b-7ba6-4cfe-bafc-490d85a645a9 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:19 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:19 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 1073741824
Sep 16 21:57:19 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-383c19f3-796f-46f8-8e4e-a4ca923c163f tempest-VolumesDeleteCascade-717720401 None] Create snapshot completed successfully
Sep 16 21:57:19 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 1073741824" returned: 0 in 0.621s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:19 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9
Sep 16 21:57:19 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:20 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" returned: 0 in 0.307s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.271s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Creating offline snapshot 7b051135-6953-4e5c-a058-3e440c69358a of volume a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fc370b-0ba0-479a-893d-2b9ee716edfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4455b-d0ac-4f6e-b54a-8a8779d39830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0812c9e-9c5f-4369-8bac-bdf477421fc9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:20 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Volume volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 (a56ef76b-7ba6-4cfe-bafc-490d85a645a9): created successfully
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef4455b-d0ac-4f6e-b54a-8a8779d39830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (c844ec3b-2e3a-4ddf-82ff-3359f5172b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-363a175a-ca29-4823-b9ae-a380e6d829e8 tempest-AttachVolumeTestJSON-1573343301 None] Created volume successfully.
Sep 16 21:57:20 devstack sudo[95823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:20 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:20 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.599s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d85679-533a-44ff-aeb0-e3cdf034d119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:21 devstack sudo[95834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a 1G
Sep 16 21:57:21 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a50b99f-9c95-4a5b-a0fd-bfae3d9c7110 req-e916f05d-90a3-43e0-a0d4-20a85bc79fac tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:21 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a 1G" returned: 0 in 0.867s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:21 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a
Sep 16 21:57:21 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:57:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:57:22 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a" returned: 0 in 0.552s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:22 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a is being set with open permissions: ugo+rw
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:22 devstack sudo[95885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a
Sep 16 21:57:22 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:22 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a" returned: 0 in 0.423s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a50b99f-9c95-4a5b-a0fd-bfae3d9c7110 req-e916f05d-90a3-43e0-a0d4-20a85bc79fac tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.142s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9a50b99f-9c95-4a5b-a0fd-bfae3d9c7110 req-e916f05d-90a3-43e0-a0d4-20a85bc79fac tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-da85a599-ec9e-4e55-bbdf-a7f3cfd35d4d tempest-VolumesDeleteCascade-717720401 None] Create snapshot completed successfully
Sep 16 21:57:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-9a50b99f-9c95-4a5b-a0fd-bfae3d9c7110 req-e916f05d-90a3-43e0-a0d4-20a85bc79fac tempest-AttachVolumeTestJSON-1573343301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e33f5f71-a37c-4d3f-92d7-6c4b90658adf', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:57:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-9a50b99f-9c95-4a5b-a0fd-bfae3d9c7110 req-e916f05d-90a3-43e0-a0d4-20a85bc79fac tempest-AttachVolumeTestJSON-1573343301 None] attachment_update completed successfully.
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-a5d85679-533a-44ff-aeb0-e3cdf034d119-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-a5d85679-533a-44ff-aeb0-e3cdf034d119-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Performing cascade delete. {{(pid=85936) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-7b051135-6953-4e5c-a058-3e440c69358a-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-7b051135-6953-4e5c-a058-3e440c69358a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-7b051135-6953-4e5c-a058-3e440c69358a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-7b051135-6953-4e5c-a058-3e440c69358a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Deleting offline snapshot 7b051135-6953-4e5c-a058-3e440c69358a of volume a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] snapshot_file for this snap is: volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1e51a2-22c1-4c5c-a86c-d61c6f4b897a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:23 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a
Sep 16 21:57:23 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:24 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a" returned: 0 in 0.507s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d85679-533a-44ff-aeb0-e3cdf034d119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a966e8-9f6d-4393-b2da-5a10eb1243c8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:24 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:24 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:25 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.678s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d85679-533a-44ff-aeb0-e3cdf034d119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:25 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a
Sep 16 21:57:25 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:25 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a" returned: 0 in 0.736s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:25 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a
Sep 16 21:57:25 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (b0256f73-f611-4762-8490-7b83214d39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:26 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce09d9-9c51-4832-b7d5-b390e91977f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.7b051135-6953-4e5c-a058-3e440c69358a" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ce09d9-9c51-4832-b7d5-b390e91977f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2141780912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186c4db2-6a0b-4e93-8260-2650350c8382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:26Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351d848-cdcc-43bb-aa27-9dd66aa22155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351d848-cdcc-43bb-aa27-9dd66aa22155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfeb977-6100-4ffd-8ea7-f9da4039570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfeb977-6100-4ffd-8ea7-f9da4039570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186c4db2-6a0b-4e93-8260-2650350c8382', 'volume_name': 'volume-186c4db2-6a0b-4e93-8260-2650350c8382', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e345dbf3-1586-4f75-8d13-16b8853ca231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e345dbf3-1586-4f75-8d13-16b8853ca231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4811e2-a880-4b9a-9d90-c9ed14db7e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Volume 186c4db2-6a0b-4e93-8260-2650350c8382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186c4db2-6a0b-4e93-8260-2650350c8382', 'volume_size': 1}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2141780912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186c4db2-6a0b-4e93-8260-2650350c8382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a6de35baf348838e823af5708ceebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:26Z,use_quota=True,user_id='ee018da9271d482cb3e402fd8db701a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Creating volume 186c4db2-6a0b-4e93-8260-2650350c8382 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:26 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-7b051135-6953-4e5c-a058-3e440c69358a" released by "_delete_snapshot" :: held 2.580s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" released by "delete_snapshot" :: held 2.638s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:26 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 1073741824
Sep 16 21:57:26 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Created reservations ['7bc9101b-4611-4f59-98d3-0fb45f16e10d', '1f3087a3-d694-4015-8f08-ae095ca84aad', '3528af31-3885-4cac-b540-7aea23c47502', '83cbb299-2459-43b7-a80b-a25ae7a927fd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Delete snapshot completed successfully.
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-7b051135-6953-4e5c-a058-3e440c69358a-delete_snapshot" released by "delete_snapshot" :: held 2.963s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-b23451d1-f73e-411e-ad30-ab01a46edd7f-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-b23451d1-f73e-411e-ad30-ab01a46edd7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-b23451d1-f73e-411e-ad30-ab01a46edd7f" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b23451d1-f73e-411e-ad30-ab01a46edd7f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Deleting offline snapshot b23451d1-f73e-411e-ad30-ab01a46edd7f of volume a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] snapshot_file for this snap is: volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a21187-413c-4429-87f2-3cf5eb6390ea]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:26 devstack sudo[95949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:26 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:27 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 1073741824" returned: 0 in 0.764s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:27 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382
Sep 16 21:57:27 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:27 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.695s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d85679-533a-44ff-aeb0-e3cdf034d119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94a03f-a7eb-46a2-bb2a-2699edfcb404]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:27 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382" returned: 0 in 0.535s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:27 devstack sudo[95959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119
Sep 16 21:57:27 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4811e2-a880-4b9a-9d90-c9ed14db7e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186c4db2-6a0b-4e93-8260-2650350c8382', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1d92c-7b7a-4c3f-86e7-24e5c48f2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:27 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Volume volume-186c4db2-6a0b-4e93-8260-2650350c8382 (186c4db2-6a0b-4e93-8260-2650350c8382): created successfully
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe1d92c-7b7a-4c3f-86e7-24e5c48f2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Flow 'volume_create_manager' (b0256f73-f611-4762-8490-7b83214d39ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3483779c-3cf3-4f06-bfd1-34e8ccdc9367 tempest-AttachVolumeTestJSON-1573343301 None] Created volume successfully.
Sep 16 21:57:27 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119" returned: 0 in 0.562s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:28 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:28 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:28 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:28 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f
Sep 16 21:57:28 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:28 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119.b23451d1-f73e-411e-ad30-ab01a46edd7f" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b23451d1-f73e-411e-ad30-ab01a46edd7f" released by "_delete_snapshot" :: held 2.291s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" released by "delete_snapshot" :: held 2.322s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:28 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Created reservations ['ef1e2027-944a-456e-af18-1ecea3e3b4aa', 'c21df377-04ac-4066-8d1f-4f455e78f307', '920e7ed5-a3a0-49f8-8f96-f254bba92322', '59449b62-f6db-4a7b-8160-98c187d4297c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Delete snapshot completed successfully.
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-b23451d1-f73e-411e-ad30-ab01a46edd7f-delete_snapshot" released by "delete_snapshot" :: held 2.524s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Snapshots deleted, issuing volume delete {{(pid=85936) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c992af-48f1-4456-bf61-25c8927dee34]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-d73c538a-244d-41ec-87d2-d0d960f713f3 req-a510efb8-668d-4a5e-aa24-9b1886481d37 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-d73c538a-244d-41ec-87d2-d0d960f713f3 req-a510efb8-668d-4a5e-aa24-9b1886481d37 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-d73c538a-244d-41ec-87d2-d0d960f713f3 req-a510efb8-668d-4a5e-aa24-9b1886481d37 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-d73c538a-244d-41ec-87d2-d0d960f713f3 req-a510efb8-668d-4a5e-aa24-9b1886481d37 tempest-AttachVolumeTestJSON-1573343301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-186c4db2-6a0b-4e93-8260-2650350c8382', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61cc0c6c-e27b-4491-b2cb-d4f346b22d4c', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:57:29 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119
Sep 16 21:57:29 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-d73c538a-244d-41ec-87d2-d0d960f713f3 req-a510efb8-668d-4a5e-aa24-9b1886481d37 tempest-AttachVolumeTestJSON-1573343301 None] attachment_update completed successfully.
Sep 16 21:57:29 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119" returned: 0 in 0.560s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:29 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119
Sep 16 21:57:29 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:30 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a5d85679-533a-44ff-aeb0-e3cdf034d119" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-a5d85679-533a-44ff-aeb0-e3cdf034d119" released by "delete_volume" :: held 1.023s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Created reservations ['3660fdb3-d743-4f49-8d51-42180afc09d8', 'e233c4f9-a3d6-42f3-b007-5f94dc2fb4c8', '5e3a078d-5031-4677-aa73-317280a7994f', '46ec9c84-ec2f-446d-a6d1-319f1102ed55'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:30 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:30 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:30 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:30 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Deleted volume successfully.
Sep 16 21:57:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0d6fcbaa-ca52-4494-b6a4-b8b03feeb582 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-a5d85679-533a-44ff-aeb0-e3cdf034d119-delete_volume" released by "delete_volume" :: held 7.206s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-46ee2c13-8c83-48ca-8d12-33177f08b399 req-9bfd4de9-331d-42a6-9ed2-99d74d4c9392 tempest-AttachVolumeTestJSON-1573343301 None] Terminate volume connection completed successfully.
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-46ee2c13-8c83-48ca-8d12-33177f08b399 req-9bfd4de9-331d-42a6-9ed2-99d74d4c9392 tempest-AttachVolumeTestJSON-1573343301 None] Deleting attachment e33f5f71-a37c-4d3f-92d7-6c4b90658adf. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (395f5cac-96ec-49d9-a6de-cc0712c5a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3583c7b4-a243-4b53-b7e6-8e0505842fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3583c7b4-a243-4b53-b7e6-8e0505842fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1468771552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b8ca2a-79d1-44e9-95f9-f23a92f02dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1dcfa55b68456dbe202d69329470f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:32Z,use_quota=True,user_id='2632f213efc84327a105cbc3f559ae25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f06604f-2a8c-42a3-926e-1d016da2eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f06604f-2a8c-42a3-926e-1d016da2eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd9ec4-b185-4cc4-b157-98c5bf5776e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd9ec4-b185-4cc4-b157-98c5bf5776e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b8ca2a-79d1-44e9-95f9-f23a92f02dd8', 'volume_name': 'volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e59b56b-123f-476c-a511-a436afff89da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e59b56b-123f-476c-a511-a436afff89da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63182ddc-ba95-4f75-894e-493a028b7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:32 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Volume 90b8ca2a-79d1-44e9-95f9-f23a92f02dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8', 'volume_size': 1}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1468771552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b8ca2a-79d1-44e9-95f9-f23a92f02dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1dcfa55b68456dbe202d69329470f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:32Z,use_quota=True,user_id='2632f213efc84327a105cbc3f559ae25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Creating volume 90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:32 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:57:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:32 devstack sudo[96029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 1073741824
Sep 16 21:57:32 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:33 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 1073741824" returned: 0 in 0.611s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:33 devstack sudo[96034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:33 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:33 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.482s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63182ddc-ba95-4f75-894e-493a028b7b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac23e3b0-1fb3-48ac-96e3-8d401f7cb9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Volume volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 (90b8ca2a-79d1-44e9-95f9-f23a92f02dd8): created successfully
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac23e3b0-1fb3-48ac-96e3-8d401f7cb9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (395f5cac-96ec-49d9-a6de-cc0712c5a10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-397c65c4-32e2-46d4-9de9-a94236eaae46 tempest-VolumesDeleteCascade-717720401 None] Created volume successfully.
Sep 16 21:57:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-bfbe410d-06fe-4e0f-9410-e649d0667980 req-ef38a71d-0527-4da6-8274-cb1d3d90b065 tempest-AttachVolumeTestJSON-1573343301 None] Terminate volume connection completed successfully.
Sep 16 21:57:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-bfbe410d-06fe-4e0f-9410-e649d0667980 req-ef38a71d-0527-4da6-8274-cb1d3d90b065 tempest-AttachVolumeTestJSON-1573343301 None] Deleting attachment 61cc0c6c-e27b-4491-b2cb-d4f346b22d4c. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Creating offline snapshot 15d464a3-7e5a-4d00-889f-e682a1536940 of volume 90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:57:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5f8232-cf06-418e-87e2-1d0aed8b1082]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:35 devstack sudo[96039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:35 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:35 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.540s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:35 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 1G
Sep 16 21:57:35 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:36 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 1G" returned: 0 in 0.869s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:36 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:36 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:36 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.407s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:36 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 is being set with open permissions: ugo+rw
Sep 16 21:57:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:36 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:36 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:37 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:37 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info
Sep 16 21:57:37 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:37 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info" returned: 0 in 0.408s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:37 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info is being set with open permissions: ugo+rw
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:37 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info
Sep 16 21:57:37 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:37 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.info" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-76e5d8d0-8a5f-4d5f-a88c-699710d6eb0e tempest-VolumesDeleteCascade-717720401 None] Create snapshot completed successfully
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (22f20a4f-f372-4a68-943d-9a825522fcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53809f18-dde4-4376-8a1f-85032454062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53809f18-dde4-4376-8a1f-85032454062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-453057485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e7416c-3819-4b55-8dbc-0fb7c6212944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1dcfa55b68456dbe202d69329470f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=15d464a3-7e5a-4d00-889f-e682a1536940,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:57:39Z,use_quota=True,user_id='2632f213efc84327a105cbc3f559ae25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fefcf3-9582-4015-acc9-844bb72988cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fefcf3-9582-4015-acc9-844bb72988cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b41183d-613e-4fa2-9a8e-73c0d51dfae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b41183d-613e-4fa2-9a8e-73c0d51dfae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4e7416c-3819-4b55-8dbc-0fb7c6212944', 'volume_name': 'volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944', 'volume_size': 1, 'snapshot_id': '15d464a3-7e5a-4d00-889f-e682a1536940'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8cc6af-ffcc-4350-87cb-ff0629f87ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8cc6af-ffcc-4350-87cb-ff0629f87ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12951c47-8680-4b50-a385-d361294b6eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:38 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Volume b4e7416c-3819-4b55-8dbc-0fb7c6212944: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944', 'volume_size': 1, 'snapshot_id': '15d464a3-7e5a-4d00-889f-e682a1536940'}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940-b4e7416c-3819-4b55-8dbc-0fb7c6212944" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940-b4e7416c-3819-4b55-8dbc-0fb7c6212944" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Creating volume b4e7416c-3819-4b55-8dbc-0fb7c6212944 from snapshot 15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] snapshot: 15d464a3-7e5a-4d00-889f-e682a1536940, volume: b4e7416c-3819-4b55-8dbc-0fb7c6212944,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2c174-ba0d-4483-8495-1f03093fc467]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:39 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:39 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:39 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.470s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[72615eb2-fcf1-421c-8fca-636060bde86d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:39 devstack sudo[96142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:39 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:39 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.454s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 21:57:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:39 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944
Sep 16 21:57:39 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-186c4db2-6a0b-4e93-8260-2650350c8382-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-186c4db2-6a0b-4e93-8260-2650350c8382-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-quobyte-186c4db2-6a0b-4e93-8260-2650350c8382" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-186c4db2-6a0b-4e93-8260-2650350c8382" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866d1ed-477e-4f67-bd68-3b52c640f343]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:40 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382
Sep 16 21:57:40 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:41 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382" returned: 0 in 0.578s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:41 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382
Sep 16 21:57:41 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:41 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-186c4db2-6a0b-4e93-8260-2650350c8382" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-186c4db2-6a0b-4e93-8260-2650350c8382" released by "delete_volume" :: held 1.043s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Created reservations ['f98051b3-3f2c-4133-bec7-b61a78958a60', '313b087a-5c10-45ec-8296-158cb9f91b90', 'b2bb92aa-3178-482d-8442-175303ae0b49', '8c6b18c8-957f-4a2b-92f3-cf14dcfb4adf'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:41 devstack sudo[96171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:41 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:42 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.575s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Deleted volume successfully.
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eb705078-cc04-44c2-b468-472da54a0d8a tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-186c4db2-6a0b-4e93-8260-2650350c8382-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-a56ef76b-7ba6-4cfe-bafc-490d85a645a9-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-a56ef76b-7ba6-4cfe-bafc-490d85a645a9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-quobyte-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" acquired by "delete_volume" :: waited 0.042s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc792a-bcc8-4222-a81b-cc6a4c44533d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:43 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9
Sep 16 21:57:43 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:43 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" returned: 0 in 0.859s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:44 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9
Sep 16 21:57:44 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:44 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" returned: 0 in 0.550s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-a56ef76b-7ba6-4cfe-bafc-490d85a645a9" released by "delete_volume" :: held 1.533s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Created reservations ['0a6bbbd2-5db2-48e2-a120-ab96586b9b43', '94d05a9f-6585-4e2b-8b57-9e68c510f795', '0c36e3bc-e379-4679-a493-db5862989e86', '4dec17c3-309e-407e-be2a-7abfb67c2bf6'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:44 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:44 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:45 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.666s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Deleted volume successfully.
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b1df373d-828c-415d-a58c-243c64809d9e tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-a56ef76b-7ba6-4cfe-bafc-490d85a645a9-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-43f402a6-f284-4d33-8106-3546bc59bec0-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-43f402a6-f284-4d33-8106-3546bc59bec0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "cinder-quobyte-43f402a6-f284-4d33-8106-3546bc59bec0" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-43f402a6-f284-4d33-8106-3546bc59bec0" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e195687-3bd1-4c3d-bfa7-2205135fee2b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:45 devstack sudo[96187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0
Sep 16 21:57:45 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:46 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0" returned: 0 in 0.556s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:46 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0
Sep 16 21:57:46 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:46 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-43f402a6-f284-4d33-8106-3546bc59bec0" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-quobyte-43f402a6-f284-4d33-8106-3546bc59bec0" released by "delete_volume" :: held 1.134s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:46 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Created reservations ['66cb1c2f-4df9-4239-9e1c-a489ba6ea212', 'dd32283d-8bf7-4eaa-9751-164e17781529', 'bb17dc1f-4853-43c7-9ee2-5eade83d0694', '531ab6cd-7517-4c80-b7f3-0a2e218f07c2'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:47 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:47 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:47 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.686s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Deleted volume successfully.
Sep 16 21:57:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbc32623-23d7-44ed-a109-f086073d20c0 tempest-AttachVolumeTestJSON-1573343301 None] Lock "cinder-43f402a6-f284-4d33-8106-3546bc59bec0-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:49 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944" returned: 0 in 10.037s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:49 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:57:49 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Converted 1024.00 MB image at 102.01 MB/s
Sep 16 21:57:49 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 is being set with open permissions: ugo+rw
Sep 16 21:57:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:50 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944
Sep 16 21:57:50 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:50 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944" returned: 0 in 0.299s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" released by "_copy_volume_from_snapshot" :: held 11.372s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940-b4e7416c-3819-4b55-8dbc-0fb7c6212944" released by "_create_volume_from_snapshot" :: held 11.460s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.481s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12951c47-8680-4b50-a385-d361294b6eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944', 'volume_size': 1, 'snapshot_id': '15d464a3-7e5a-4d00-889f-e682a1536940'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80bb495-a817-4bfc-ab08-6889c2243cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:57:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Volume volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 (b4e7416c-3819-4b55-8dbc-0fb7c6212944): created successfully
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80bb495-a817-4bfc-ab08-6889c2243cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:57:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Flow 'volume_create_manager' (22f20a4f-f372-4a68-943d-9a825522fcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:57:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2781b1df-9852-4ae9-897f-45d346d731d3 tempest-VolumesDeleteCascade-717720401 None] Created volume successfully.
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Performing cascade delete. {{(pid=85936) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-15d464a3-7e5a-4d00-889f-e682a1536940-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-15d464a3-7e5a-4d00-889f-e682a1536940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Deleting offline snapshot 15d464a3-7e5a-4d00-889f-e682a1536940 of volume 90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] snapshot_file for this snap is: volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45c545-790e-44b9-bec4-5bc94b669338]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:51 devstack sudo[96238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:51 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:52 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.453s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fb50e6-2163-419b-a13f-dfe827929eeb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:52 devstack sudo[96243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:52 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:52 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.651s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:52 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:52 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:53 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:53 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940
Sep 16 21:57:53 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:53 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8.15d464a3-7e5a-4d00-889f-e682a1536940" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-15d464a3-7e5a-4d00-889f-e682a1536940" released by "_delete_snapshot" :: held 1.912s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" released by "delete_snapshot" :: held 1.940s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Created reservations ['f1ad8bd8-49a8-4266-9d8e-b0cea7840234', 'be6169fe-b399-478d-9edd-ff3ae658eff8', '5e35ea47-3cce-44c7-a7a6-399a55c09643', '02d804ad-38a0-477b-a80f-3669cad75c3e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Delete snapshot completed successfully.
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-15d464a3-7e5a-4d00-889f-e682a1536940-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Snapshots deleted, issuing volume delete {{(pid=85936) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f3e5f-c202-4bb8-a0af-c39f0825972a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:53 devstack sudo[96258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:53 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:54 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.510s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:54 devstack sudo[96263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8
Sep 16 21:57:54 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:54 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" returned: 0 in 0.289s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8" released by "delete_volume" :: held 0.888s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Created reservations ['fe31c431-6021-41f3-8d15-ebfc8d996b14', 'c52db7e5-c4fb-43d4-b48d-455721cb6b81', '20f99daa-dd08-47f2-9825-a25c1db64f44', 'c4ae28e9-ccdb-49ee-9ece-28d3d3f1c565'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:54 devstack sudo[96266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:54 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-b4e7416c-3819-4b55-8dbc-0fb7c6212944-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-b4e7416c-3819-4b55-8dbc-0fb7c6212944-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5997a4-f45b-4993-b9cb-21630cde4cc4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:54 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:55 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Deleted volume successfully.
Sep 16 21:57:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6a0ecf61-b9ad-48f3-ae14-377e70e3406a tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-90b8ca2a-79d1-44e9-95f9-f23a92f02dd8-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:55 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944
Sep 16 21:57:55 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:55 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944" returned: 0 in 0.667s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:55 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944
Sep 16 21:57:55 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-8a0e2e8b-6fc6-4531-8dc9-7d5ab2b25068 req-e62a6955-2db8-4715-81cf-da852f3ce458 tempest-AttachVolumeNegativeTest-384733218 None] Terminate volume connection completed successfully.
Sep 16 21:57:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-8a0e2e8b-6fc6-4531-8dc9-7d5ab2b25068 req-e62a6955-2db8-4715-81cf-da852f3ce458 tempest-AttachVolumeNegativeTest-384733218 None] Deleting attachment cad003b8-f5c2-47f1-bb66-ebdf323f04b4. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:57:56 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b4e7416c-3819-4b55-8dbc-0fb7c6212944" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-quobyte-b4e7416c-3819-4b55-8dbc-0fb7c6212944" released by "delete_volume" :: held 1.143s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Created reservations ['8edfbf67-ddbc-4d1f-bcb1-bbd63cbe64c3', '17591575-c2e2-43ad-abe8-9ae81c68fa25', 'a31f362f-e542-461c-a65e-65d22749ae7c', 'fc462bc7-7d83-4147-a0bb-62ee2eae0cbf'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:57:56 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:57:56 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:57:56 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:57:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Deleted volume successfully.
Sep 16 21:57:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b853b600-c8ff-4846-9736-33ec51a3be6b tempest-VolumesDeleteCascade-717720401 None] Lock "cinder-b4e7416c-3819-4b55-8dbc-0fb7c6212944-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (15de7434-08e6-4ac8-8d58-27d646973b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c256ad-5de0-4dd9-90f7-5348798662fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c256ad-5de0-4dd9-90f7-5348798662fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1123873782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49106b57-451a-4b21-bf77-92ee9dd0d6e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:01Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f842cd5-e585-4c09-8f5c-8d1639cec6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f842cd5-e585-4c09-8f5c-8d1639cec6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f319388-87ff-40f6-b5e1-55f10fc0ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f319388-87ff-40f6-b5e1-55f10fc0ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49106b57-451a-4b21-bf77-92ee9dd0d6e5', 'volume_name': 'volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79377c61-58b0-4c79-a872-878a90a52d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79377c61-58b0-4c79-a872-878a90a52d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229360ea-fd0b-44e9-a018-fa10f9cb3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Volume 49106b57-451a-4b21-bf77-92ee9dd0d6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5', 'volume_size': 1}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1123873782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49106b57-451a-4b21-bf77-92ee9dd0d6e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:01Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Creating volume 49106b57-451a-4b21-bf77-92ee9dd0d6e5 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:01 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:01 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 1073741824
Sep 16 21:58:01 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:01 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 1073741824" returned: 0 in 0.616s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:01 devstack sudo[96311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5
Sep 16 21:58:01 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:02 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229360ea-fd0b-44e9-a018-fa10f9cb3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8da384-240b-4f74-92c9-dedaf9ea838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:02 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Volume volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 (49106b57-451a-4b21-bf77-92ee9dd0d6e5): created successfully
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8da384-240b-4f74-92c9-dedaf9ea838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (15de7434-08e6-4ac8-8d58-27d646973b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3634bc60-6789-451e-8755-b3bfc81e77c0 tempest-VolumesTestJSON-1305964745 None] Created volume successfully.
Sep 16 21:58:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (a0f5cdd2-5869-4403-8e4f-8f3b47b03127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e384c57c-ed57-4b20-b6ec-45712eda2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e384c57c-ed57-4b20-b6ec-45712eda2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1240014322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456662d4-fed0-4c2e-bb7a-7738c3275c2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:04Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90176192-b3b4-40dc-aef9-655fff24a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90176192-b3b4-40dc-aef9-655fff24a90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe68911f-e170-4dd9-8233-651d47921829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe68911f-e170-4dd9-8233-651d47921829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456662d4-fed0-4c2e-bb7a-7738c3275c2a', 'volume_name': 'volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b64d7f-4cbd-4bd1-8977-4f9c07298559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b64d7f-4cbd-4bd1-8977-4f9c07298559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b91b2eb-93f7-45ab-8c41-0ea9e0d4cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Volume 456662d4-fed0-4c2e-bb7a-7738c3275c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a', 'volume_size': 1}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1240014322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456662d4-fed0-4c2e-bb7a-7738c3275c2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:04Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Creating volume 456662d4-fed0-4c2e-bb7a-7738c3275c2a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:04 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:04 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a 1073741824
Sep 16 21:58:04 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:04 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a 1073741824" returned: 0 in 0.606s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:04 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a
Sep 16 21:58:04 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:05 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a" returned: 0 in 0.318s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b91b2eb-93f7-45ab-8c41-0ea9e0d4cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06db9979-6147-4a3d-96df-db2b99092844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Volume volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a (456662d4-fed0-4c2e-bb7a-7738c3275c2a): created successfully
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06db9979-6147-4a3d-96df-db2b99092844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (a0f5cdd2-5869-4403-8e4f-8f3b47b03127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-81360fd6-70d3-4a30-bbab-580f0305d9b9 tempest-VolumesTestJSON-1305964745 None] Created volume successfully.
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (fa2ebac9-b052-4ba8-974e-e824ac035c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60950e5f-c277-44aa-a018-b515b7daae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60950e5f-c277-44aa-a018-b515b7daae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-258182696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5419b5-4b1f-4608-99a8-96c9b6839e07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:07Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96281a6d-d453-4eff-9049-989ba29a0983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96281a6d-d453-4eff-9049-989ba29a0983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1e7a00-2d34-4042-bd79-b8aecfa37399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1e7a00-2d34-4042-bd79-b8aecfa37399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5419b5-4b1f-4608-99a8-96c9b6839e07', 'volume_name': 'volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b47de04-227d-44da-8a34-03c35ba74bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b47de04-227d-44da-8a34-03c35ba74bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c522fedc-16a4-4bed-95bf-b185ced81784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Volume ee5419b5-4b1f-4608-99a8-96c9b6839e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07', 'volume_size': 1}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-258182696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5419b5-4b1f-4608-99a8-96c9b6839e07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbd56597794e49a3b104181bd15c9eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:07Z,use_quota=True,user_id='3dedaa3e58474e4db965261fde3cb444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Creating volume ee5419b5-4b1f-4608-99a8-96c9b6839e07 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:06 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:06 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 1073741824
Sep 16 21:58:06 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:07 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 1073741824" returned: 0 in 0.477s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:07 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07
Sep 16 21:58:07 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:07 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c522fedc-16a4-4bed-95bf-b185ced81784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14ef191-52ba-432e-818b-e2d302fdaedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Volume volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 (ee5419b5-4b1f-4608-99a8-96c9b6839e07): created successfully
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14ef191-52ba-432e-818b-e2d302fdaedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Flow 'volume_create_manager' (fa2ebac9-b052-4ba8-974e-e824ac035c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ef16f1e9-064b-43b7-97d6-5e2e68fcc554 tempest-VolumesTestJSON-1305964745 None] Created volume successfully.
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-ee5419b5-4b1f-4608-99a8-96c9b6839e07-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "cinder-ee5419b5-4b1f-4608-99a8-96c9b6839e07-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-quobyte-ee5419b5-4b1f-4608-99a8-96c9b6839e07" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-ee5419b5-4b1f-4608-99a8-96c9b6839e07" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7a274-7957-4543-8810-116d7a8d2871]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:10 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07
Sep 16 21:58:10 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:11 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07" returned: 0 in 0.471s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:11 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07
Sep 16 21:58:11 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:11 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee5419b5-4b1f-4608-99a8-96c9b6839e07" returned: 0 in 0.415s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-ee5419b5-4b1f-4608-99a8-96c9b6839e07" released by "delete_volume" :: held 0.973s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Created reservations ['1dea02cc-c7af-45b2-98ba-d17222fa2f64', 'c12d062a-dd32-481c-a1f5-29bd7ed9835e', '8ebfae7b-7487-4e47-83c2-06f36a60cbef', 'c82584e8-d8e1-4747-80c4-f89eca1c3fad'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:12 devstack sudo[96349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:58:12 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:12 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:12 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:58:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Deleted volume successfully.
Sep 16 21:58:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd59bdbc-914f-480a-9ada-293a8162eabf tempest-VolumesTestJSON-1305964745 None] Lock "cinder-ee5419b5-4b1f-4608-99a8-96c9b6839e07-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-456662d4-fed0-4c2e-bb7a-7738c3275c2a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-456662d4-fed0-4c2e-bb7a-7738c3275c2a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-quobyte-456662d4-fed0-4c2e-bb7a-7738c3275c2a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-456662d4-fed0-4c2e-bb7a-7738c3275c2a" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[567c4e5b-e0da-483f-8693-184ac9938180]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:13 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a
Sep 16 21:58:13 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:13 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:13 devstack sudo[96403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a
Sep 16 21:58:13 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:13 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-456662d4-fed0-4c2e-bb7a-7738c3275c2a" returned: 0 in 0.283s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-456662d4-fed0-4c2e-bb7a-7738c3275c2a" released by "delete_volume" :: held 0.844s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Created reservations ['33b30b26-53c8-4c94-a318-94c2c67d5a3c', '24fb9345-02d0-406a-b573-1d88a13b9360', '94a48697-fe61-450c-8fd2-1992e7a92724', '5d823d03-f70d-437e-a943-8c8c94b9f1b7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:14 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:58:14 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-49106b57-451a-4b21-bf77-92ee9dd0d6e5-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-49106b57-451a-4b21-bf77-92ee9dd0d6e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "cinder-quobyte-49106b57-451a-4b21-bf77-92ee9dd0d6e5" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-49106b57-451a-4b21-bf77-92ee9dd0d6e5" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f110a46-53dc-4594-9895-245e0be0da38]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:14 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.366s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:58:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Deleted volume successfully.
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-784aad99-a39f-4c13-9e31-6305b4825856 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-456662d4-fed0-4c2e-bb7a-7738c3275c2a-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:14 devstack sudo[96412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5
Sep 16 21:58:14 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:14 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5" returned: 0 in 0.462s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:14 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5
Sep 16 21:58:14 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:15 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-49106b57-451a-4b21-bf77-92ee9dd0d6e5" returned: 0 in 0.287s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-quobyte-49106b57-451a-4b21-bf77-92ee9dd0d6e5" released by "delete_volume" :: held 0.833s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Created reservations ['04d711ab-a897-4fd7-8eb1-24ba368f67c0', '8d72a550-0d15-4c2c-9b26-ffd894ce32f0', '02ead185-1388-4d96-bb4e-e584c38e45f2', '30d6805a-df4a-473e-801c-998948b7bbc1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:15 devstack sudo[96421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:58:15 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:15 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:58:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Deleted volume successfully.
Sep 16 21:58:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-84d9d77a-be9b-49e5-a16e-18ed297ac5f9 tempest-VolumesTestJSON-1305964745 None] Lock "cinder-49106b57-451a-4b21-bf77-92ee9dd0d6e5-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Flow 'volume_create_manager' (d92b1799-3ae2-4524-a98b-4d904c6c6536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b94cb-0d1b-4c1a-a765-36834ff15b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b94cb-0d1b-4c1a-a765-36834ff15b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1527738308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98d0a95-fc33-41ac-9a28-8a2896ece496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e03214b2dd4e3fb6a123fa9e2e2371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:18Z,use_quota=True,user_id='d8e5b7bd28394917a44ff0ea09802f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f6a6e-89b6-4e24-8c59-7cf81194caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f6a6e-89b6-4e24-8c59-7cf81194caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff593ae8-9278-4876-9d9c-50f4987cf837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff593ae8-9278-4876-9d9c-50f4987cf837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98d0a95-fc33-41ac-9a28-8a2896ece496', 'volume_name': 'volume-c98d0a95-fc33-41ac-9a28-8a2896ece496', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07116a8-df6c-4ae6-abaa-1ea366f48702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07116a8-df6c-4ae6-abaa-1ea366f48702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f580087e-de5e-4c4e-944e-fa1b5e7872bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:17 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Volume c98d0a95-fc33-41ac-9a28-8a2896ece496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98d0a95-fc33-41ac-9a28-8a2896ece496', 'volume_size': 1}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1527738308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98d0a95-fc33-41ac-9a28-8a2896ece496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e03214b2dd4e3fb6a123fa9e2e2371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:18Z,use_quota=True,user_id='d8e5b7bd28394917a44ff0ea09802f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Creating volume c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:17 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:17 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 1073741824
Sep 16 21:58:17 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:18 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 1073741824" returned: 0 in 0.550s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:18 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:58:18 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:18 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.470s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=117,cinder:SELECT=87,cinder:DELETE=5,cinder:INSERT=28 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f580087e-de5e-4c4e-944e-fa1b5e7872bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98d0a95-fc33-41ac-9a28-8a2896ece496', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91da6fac-e47e-43bd-93fd-2fcce39abacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=118,cinder:UPDATE=121,cinder:INSERT=30,cinder:DELETE=14 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:58:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Volume volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 (c98d0a95-fc33-41ac-9a28-8a2896ece496): created successfully
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91da6fac-e47e-43bd-93fd-2fcce39abacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Flow 'volume_create_manager' (d92b1799-3ae2-4524-a98b-4d904c6c6536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fbfddd88-23e8-407f-8b1e-d1fed91364c2 tempest-VolumesActionsTest-835339281 None] Created volume successfully.
Sep 16 21:58:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:58:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:22 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:58:22 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:22 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.864s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:58:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Flow 'volume_create_manager' (d273f9b8-39da-48f5-945e-82ecbd1aab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b305f68-7d63-4aa2-b4ae-5b4e78c80aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b305f68-7d63-4aa2-b4ae-5b4e78c80aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1667795570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0f5949-84d2-4c6e-b00e-6d038765011d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee83d628c44906966e43db1676a093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:27Z,use_quota=True,user_id='33865be09f0143628f0be1c4e285272c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148c0f5a-e220-4f06-8054-26b65b9b7481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148c0f5a-e220-4f06-8054-26b65b9b7481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc173d3-b540-497c-909e-0a314468e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc173d3-b540-497c-909e-0a314468e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0f5949-84d2-4c6e-b00e-6d038765011d', 'volume_name': 'volume-ee0f5949-84d2-4c6e-b00e-6d038765011d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1048edf8-d77a-497c-921d-14a3f65cee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1048edf8-d77a-497c-921d-14a3f65cee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36fc34-82b0-4829-845a-8bde042c5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Volume ee0f5949-84d2-4c6e-b00e-6d038765011d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0f5949-84d2-4c6e-b00e-6d038765011d', 'volume_size': 1}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1667795570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0f5949-84d2-4c6e-b00e-6d038765011d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee83d628c44906966e43db1676a093',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:27Z,use_quota=True,user_id='33865be09f0143628f0be1c4e285272c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Creating volume ee0f5949-84d2-4c6e-b00e-6d038765011d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:26 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:26 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d 1073741824
Sep 16 21:58:26 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:27 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d 1073741824" returned: 0 in 1.069s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:28 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d
Sep 16 21:58:28 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:28 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d" returned: 0 in 0.676s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a36fc34-82b0-4829-845a-8bde042c5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0f5949-84d2-4c6e-b00e-6d038765011d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c03896a-8407-4013-a204-4f9a53965d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:28 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Volume volume-ee0f5949-84d2-4c6e-b00e-6d038765011d (ee0f5949-84d2-4c6e-b00e-6d038765011d): created successfully
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c03896a-8407-4013-a204-4f9a53965d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Flow 'volume_create_manager' (d273f9b8-39da-48f5-945e-82ecbd1aab3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1f0dd0bb-cc96-4370-89dd-4fe0d1374cb5 tempest-TestMinimumBasicScenario-2054799409 None] Created volume successfully.
Sep 16 21:58:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-1dadc642-74d2-410b-a5cd-7d574ba5be75 req-374fbadc-5873-46a4-8fa9-d45566cd4d15 tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-1dadc642-74d2-410b-a5cd-7d574ba5be75 req-374fbadc-5873-46a4-8fa9-d45566cd4d15 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-1dadc642-74d2-410b-a5cd-7d574ba5be75 req-374fbadc-5873-46a4-8fa9-d45566cd4d15 tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-1dadc642-74d2-410b-a5cd-7d574ba5be75 req-374fbadc-5873-46a4-8fa9-d45566cd4d15 tempest-TestMinimumBasicScenario-2054799409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-ee0f5949-84d2-4c6e-b00e-6d038765011d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f903ac6d-9dba-454a-958c-51c9490b598f', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:58:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-1dadc642-74d2-410b-a5cd-7d574ba5be75 req-374fbadc-5873-46a4-8fa9-d45566cd4d15 tempest-TestMinimumBasicScenario-2054799409 None] attachment_update completed successfully.
Sep 16 21:58:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5956925b-2736-44b2-8dd5-7b602b07fb89 tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" by "attach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5956925b-2736-44b2-8dd5-7b602b07fb89 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" acquired by "attach_volume" :: waited 0.054s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5956925b-2736-44b2-8dd5-7b602b07fb89 tempest-VolumesActionsTest-835339281 None] Attaching volume c98d0a95-fc33-41ac-9a28-8a2896ece496 to instance 5cb50c81-8ff9-49a5-806c-89854db019fc at mountpoint /dev/vdb on host None.
Sep 16 21:58:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5956925b-2736-44b2-8dd5-7b602b07fb89 tempest-VolumesActionsTest-835339281 None] Attach volume completed successfully.
Sep 16 21:58:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5956925b-2736-44b2-8dd5-7b602b07fb89 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" released by "attach_volume" :: held 0.181s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0e8e07aa-2f42-4fdf-89c2-5df4b98bfdbf tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" by "detach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0e8e07aa-2f42-4fdf-89c2-5df4b98bfdbf tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0e8e07aa-2f42-4fdf-89c2-5df4b98bfdbf tempest-VolumesActionsTest-835339281 None] Detaching volume c98d0a95-fc33-41ac-9a28-8a2896ece496 from instance 5cb50c81-8ff9-49a5-806c-89854db019fc.
Sep 16 21:58:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0e8e07aa-2f42-4fdf-89c2-5df4b98bfdbf tempest-VolumesActionsTest-835339281 None] Detach volume completed successfully.
Sep 16 21:58:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0e8e07aa-2f42-4fdf-89c2-5df4b98bfdbf tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b1b96d98-1571-4cff-8db3-b1bc9d395319 tempest-GroupsV314Test-1105844639 None] Group tempest-GroupsV314Test-Group-472486455: creating
Sep 16 21:58:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b1b96d98-1571-4cff-8db3-b1bc9d395319 tempest-GroupsV314Test-1105844639 None] Group tempest-GroupsV314Test-Group-472486455: created successfully
Sep 16 21:58:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b1b96d98-1571-4cff-8db3-b1bc9d395319 tempest-GroupsV314Test-1105844639 None] Create group completed successfully.
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Flow 'volume_create_manager' (d085878c-2d28-46bd-a50c-f534ad48e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fc7906-b3d7-42d8-8544-54e97ae0baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fc7906-b3d7-42d8-8544-54e97ae0baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686624647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=437e568a-6be4-40f1-8c5a-da85576a5f2a,host='devstack@QuobyteHD#QuobyteHD',id=ef67db3b-9620-4e1d-a21a-e94a37f03218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bb9672177f4eb1a0933478e8d87091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:43Z,use_quota=True,user_id='1b194219793f4a028b4790c6a9528329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf72eab-42b0-40cd-8a26-f9e0ee2335ec),volume_type_id=3cf72eab-42b0-40cd-8a26-f9e0ee2335ec)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fdd84d-fa35-48a0-85ff-d216263b7b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fdd84d-fa35-48a0-85ff-d216263b7b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73902463-b740-4922-85b4-62d1021c76ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73902463-b740-4922-85b4-62d1021c76ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef67db3b-9620-4e1d-a21a-e94a37f03218', 'volume_name': 'volume-ef67db3b-9620-4e1d-a21a-e94a37f03218', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aa7ac8-cd7c-4b2b-919f-2502eb6eaacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4aa7ac8-cd7c-4b2b-919f-2502eb6eaacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bedfe-a504-4b76-a8e3-7b57fa3e5e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Volume ef67db3b-9620-4e1d-a21a-e94a37f03218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef67db3b-9620-4e1d-a21a-e94a37f03218', 'volume_size': 1}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=437e568a-6be4-40f1-8c5a-da85576a5f2a,created_at=2026-09-16T19:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686624647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=437e568a-6be4-40f1-8c5a-da85576a5f2a,host='devstack@QuobyteHD#QuobyteHD',id=ef67db3b-9620-4e1d-a21a-e94a37f03218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bb9672177f4eb1a0933478e8d87091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:43Z,use_quota=True,user_id='1b194219793f4a028b4790c6a9528329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf72eab-42b0-40cd-8a26-f9e0ee2335ec),volume_type_id=3cf72eab-42b0-40cd-8a26-f9e0ee2335ec)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Creating volume ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:58:42 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:58:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:42 devstack sudo[97237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 1073741824
Sep 16 21:58:42 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:43 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 1073741824" returned: 0 in 0.553s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:43 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:58:43 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:43 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bedfe-a504-4b76-a8e3-7b57fa3e5e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef67db3b-9620-4e1d-a21a-e94a37f03218', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7fe7bb-e7da-4629-ac1b-ba17a56a963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Volume volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 (ef67db3b-9620-4e1d-a21a-e94a37f03218): created successfully
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7fe7bb-e7da-4629-ac1b-ba17a56a963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Flow 'volume_create_manager' (d085878c-2d28-46bd-a50c-f534ad48e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e795de73-6869-4326-ad0c-cd47110c14fa tempest-GroupsV314Test-1105844639 None] Created volume successfully.
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:45 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Cloning volume ef67db3b-9620-4e1d-a21a-e94a37f03218 to volume c9f9fbe2-f904-442b-9d83-ab456bd0eb97
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Creating offline snapshot 5280f45f-e6e1-4d04-8d08-f0965e27bd96 of volume ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473094e-85af-489e-a6d7-cd5389e9eac3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:45 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:58:45 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:45 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.759s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:45 devstack sudo[97268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 1G
Sep 16 21:58:45 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:46 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 1G" returned: 0 in 0.637s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:46 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:58:46 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.591s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:58:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:47 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:47 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:58:47 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:47 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.543s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:47 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info
Sep 16 21:58:47 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:48 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info" returned: 0 in 0.336s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:48 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:48 devstack sudo[97297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info
Sep 16 21:58:48 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:48 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.info" returned: 0 in 0.398s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Acquiring lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] snapshot: 5280f45f-e6e1-4d04-8d08-f0965e27bd96, volume: c9f9fbe2-f904-442b-9d83-ab456bd0eb97,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877207c-d8d1-4f8c-ac09-52940e3e6f6a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:48 devstack sudo[97300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:58:48 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:49 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.873s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef67db3b-9620-4e1d-a21a-e94a37f03218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:58:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[567992ec-0b16-4bf7-a6f9-f548a1533f0c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:58:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:49 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:58:49 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:50 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Sep 16 21:58:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.719s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:58:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 21:58:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 21:58:50 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 21:58:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:58:50 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97
Sep 16 21:58:50 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (badedf54-f299-4c75-bf4d-d7e87b70a790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee0e06-7d67-4b46-abc4-7e1dfc26f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ee0e06-7d67-4b46-abc4-7e1dfc26f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1542760200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:51Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e4ed82-8d18-4d72-b2cf-7eb1f7f25d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e4ed82-8d18-4d72-b2cf-7eb1f7f25d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c70c0-7532-4334-af12-754a2f3434d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c70c0-7532-4334-af12-754a2f3434d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25', 'volume_name': 'volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a791cf-d5e7-4f53-bec0-12b5d0b9349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a791cf-d5e7-4f53-bec0-12b5d0b9349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c99eab-9faa-4bca-8628-cd38cdd8acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:58:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Volume daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25', 'volume_size': 1}
Sep 16 21:58:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:58:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6387e163-dc7a-4c99-95c9-63d35dc9dc28 tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" by "attach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6387e163-dc7a-4c99-95c9-63d35dc9dc28 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" acquired by "attach_volume" :: waited 0.051s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6387e163-dc7a-4c99-95c9-63d35dc9dc28 tempest-VolumesActionsTest-835339281 None] Attaching volume c98d0a95-fc33-41ac-9a28-8a2896ece496 to instance 3dda0baf-27b2-4bb2-bec8-cd76b2bc6cea at mountpoint /dev/vdb on host None.
Sep 16 21:58:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6387e163-dc7a-4c99-95c9-63d35dc9dc28 tempest-VolumesActionsTest-835339281 None] Attach volume completed successfully.
Sep 16 21:58:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6387e163-dc7a-4c99-95c9-63d35dc9dc28 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496" released by "attach_volume" :: held 0.250s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:58:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9c1516ad-bb48-4172-b13c-f508b699e2df tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" by "detach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:58:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9c1516ad-bb48-4172-b13c-f508b699e2df tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:58:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9c1516ad-bb48-4172-b13c-f508b699e2df tempest-VolumesActionsTest-835339281 None] Detaching volume c98d0a95-fc33-41ac-9a28-8a2896ece496 from instance 3dda0baf-27b2-4bb2-bec8-cd76b2bc6cea.
Sep 16 21:58:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9c1516ad-bb48-4172-b13c-f508b699e2df tempest-VolumesActionsTest-835339281 None] Detach volume completed successfully.
Sep 16 21:58:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9c1516ad-bb48-4172-b13c-f508b699e2df tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:01 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" returned: 0 in 11.219s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218, size 1024.00 MB, duration 11.22 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:59:01 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Converted 1024.00 MB image at 91.27 MB/s
Sep 16 21:59:01 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:01 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97
Sep 16 21:59:01 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:01 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" returned: 0 in 0.266s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" released by "_copy_volume_from_snapshot" :: held 13.191s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Acquiring lock "cinder-quobyte-5280f45f-e6e1-4d04-8d08-f0965e27bd96" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-5280f45f-e6e1-4d04-8d08-f0965e27bd96" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Deleting offline snapshot 5280f45f-e6e1-4d04-8d08-f0965e27bd96 of volume ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] snapshot_file for this snap is: volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5808b13-3b6e-455b-8a49-e0fd07a10394]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:01 devstack sudo[97473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:59:01 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:02 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef67db3b-9620-4e1d-a21a-e94a37f03218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e8f56-1f20-4813-9960-95af65b173fb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:02 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:59:02 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:02 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.575s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:02 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:59:02 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:03 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.325s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:03 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96
Sep 16 21:59:03 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:03 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218.5280f45f-e6e1-4d04-8d08-f0965e27bd96" returned: 0 in 0.253s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-5280f45f-e6e1-4d04-8d08-f0965e27bd96" released by "_delete_snapshot" :: held 1.663s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.418s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.952s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1542760200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:58:51Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Creating volume daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:59:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:03 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 1073741824
Sep 16 21:59:03 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fd7e4f9a-09bd-4f73-a559-e6445a595230 tempest-GroupsV314Test-1105844639 None] Create group from source-group-437e568a-6be4-40f1-8c5a-da85576a5f2a completed successfully.
Sep 16 21:59:03 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 1073741824" returned: 0 in 0.462s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:04 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25
Sep 16 21:59:04 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:04 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.467s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c99eab-9faa-4bca-8628-cd38cdd8acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d8c56c-3151-48ce-a08d-2af5cd340092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92f3533-ba87-4675-8146-25947e374b26]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Volume volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 (daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25): created successfully
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d8c56c-3151-48ce-a08d-2af5cd340092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (badedf54-f299-4c75-bf4d-d7e87b70a790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:59:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-14e25cdd-e36d-455f-8057-002d39b4c114 tempest-AttachVolumeNegativeTest-384733218 None] Created volume successfully.
Sep 16 21:59:04 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:04 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:04 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f470977-d0d7-4bf8-8a4a-536c0cc836be]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:04 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:04 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:05 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.f000e898-3d47-4d30-b592-f300d0cecb03ehw_3br8.img {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:05 devstack sudo[97513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.f000e898-3d47-4d30-b592-f300d0cecb03ehw_3br8.img
Sep 16 21:59:05 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Acquiring lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3535844a-4168-40de-9e2d-c479a149d213]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:05 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97
Sep 16 21:59:05 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-7437ca79-70ff-4e11-8829-e899dc22ff1e req-d3d4c6c0-50fd-4ff9-9a7a-12e2e6591c54 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:06 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" returned: 0 in 1.198s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:06 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97
Sep 16 21:59:06 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:07 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" returned: 0 in 0.589s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-c9f9fbe2-f904-442b-9d83-ab456bd0eb97" released by "delete_volume" :: held 1.891s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Created reservations ['ede2eed2-d304-4e94-9edc-71b5c8664d28'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:07 devstack cinder-volume[85936]: WARNING cinder.quota [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1700218435 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1700218435, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:59:07 devstack cinder-volume[85936]: WARNING cinder.quota [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1700218435 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1700218435, it is now deprecated. Please use the default quota class for default quota.
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Created reservations ['1eecf6e6-7892-4475-8bc6-75501706c7ff', '40094201-230c-4b3a-b2c8-fed37b92df4a', '08e73277-ddc8-4c0c-8e76-e8c6fbe2dbf6', '029c6c86-6fcc-4def-8e6e-3f10775df7ef'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:07 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:59:07 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:08 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.514s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:59:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a774fe14-5f6c-424d-a141-93631c5030e1 tempest-GroupsV314Test-1105844639 None] Delete group completed successfully.
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Acquiring lock "cinder-quobyte-ef67db3b-9620-4e1d-a21a-e94a37f03218" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-ef67db3b-9620-4e1d-a21a-e94a37f03218" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbed688-bbde-486e-a194-9cf21f308497]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:09 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:59:09 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:09 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.705s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:09 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218
Sep 16 21:59:09 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:10 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ef67db3b-9620-4e1d-a21a-e94a37f03218" returned: 0 in 0.474s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Lock "cinder-quobyte-ef67db3b-9620-4e1d-a21a-e94a37f03218" released by "delete_volume" :: held 1.336s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Created reservations ['b047bef2-7127-419f-93aa-6e734c0bfdae'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Created reservations ['1677116b-1e8a-4f02-8b2f-627b5ef6de98', '3e5f7d15-bd95-44a4-8dd1-55bc642a88d4', '7fbe5a7c-8317-4cbe-b047-47a1f4195023', '17d2c200-b24c-48f5-8ce2-c4ae14e98bc1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:10 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:59:10 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:10 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.420s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:10 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:59:10 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2c156c06-d0b8-4196-9249-c944000e504c tempest-GroupsV314Test-1105844639 None] Delete group completed successfully.
Sep 16 21:59:12 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.f000e898-3d47-4d30-b592-f300d0cecb03ehw_3br8.img" returned: 0 in 7.801s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb35d9c6-4616-42c1-ab01-2cf00c800c16]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:13 devstack sudo[97560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:13 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:13 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.561s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:13 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.f000e898-3d47-4d30-b592-f300d0cecb03ehw_3br8.img {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:59:13 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Converted 1024.00 MB image at 131.25 MB/s
Sep 16 21:59:13 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] f000e898-3d47-4d30-b592-f300d0cecb03 was raw, no need to convert to raw {{(pid=85936) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Flow 'volume_create_manager' (fa33f044-2293-48e5-b684-aa82ab49545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c5386-fd36-42b8-b68b-f48f2f01f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c5386-fd36-42b8-b68b-f48f2f01f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1616224471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34095a87-0e07-4683-8864-49afd531d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a0a98df19f4c788efd11a2381cc94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:59:19Z,use_quota=True,user_id='ca02db196b3240e6942bee6b2fddec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25cc6a4-fbef-4020-a6e7-26c6d383342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25cc6a4-fbef-4020-a6e7-26c6d383342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1f338e-416b-4de4-9726-cde132b42964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1f338e-416b-4de4-9726-cde132b42964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34095a87-0e07-4683-8864-49afd531d217', 'volume_name': 'volume-34095a87-0e07-4683-8864-49afd531d217', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062308d2-d5b7-4af9-8d6b-54810e54ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062308d2-d5b7-4af9-8d6b-54810e54ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9a472b-0f38-4d14-8571-bfdba047529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Volume 34095a87-0e07-4683-8864-49afd531d217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34095a87-0e07-4683-8864-49afd531d217', 'volume_size': 1}
Sep 16 21:59:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:19 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=55,cinder:UPDATE=41,cinder:INSERT=7 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:59:19 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=46,cinder:DELETE=4,cinder:SELECT=55,cinder:INSERT=12 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:59:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-0095f7e4-128b-4fed-9289-7ba0c6604230 req-adafd148-5d81-44c9-9f6b-8a43267b09ea tempest-TestMinimumBasicScenario-2054799409 None] Terminate volume connection completed successfully.
Sep 16 21:59:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-0095f7e4-128b-4fed-9289-7ba0c6604230 req-adafd148-5d81-44c9-9f6b-8a43267b09ea tempest-TestMinimumBasicScenario-2054799409 None] Deleting attachment f903ac6d-9dba-454a-958c-51c9490b598f. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:59:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "cinder-ee0f5949-84d2-4c6e-b00e-6d038765011d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "cinder-ee0f5949-84d2-4c6e-b00e-6d038765011d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "cinder-quobyte-ee0f5949-84d2-4c6e-b00e-6d038765011d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "cinder-quobyte-ee0f5949-84d2-4c6e-b00e-6d038765011d" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973b353-060a-4e20-874c-9d8852538d36]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:21 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d
Sep 16 21:59:21 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:21 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d" returned: 0 in 0.398s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:21 devstack sudo[97584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d
Sep 16 21:59:21 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:21 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ee0f5949-84d2-4c6e-b00e-6d038765011d" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "cinder-quobyte-ee0f5949-84d2-4c6e-b00e-6d038765011d" released by "delete_volume" :: held 0.713s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Created reservations ['f3efbed7-d5d5-42ca-888d-f41ccc9277ae', 'bf0e1cd4-2bcf-48ef-984a-43c8bc334624', '1dcff30c-1663-4f9c-b655-2294b93912b2', 'ed72831a-a275-43f0-be8c-a0fc09715e5c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:21 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:59:21 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:22 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:59:22 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:22 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.397s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:59:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Deleted volume successfully.
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fa4830d8-89f3-411a-9c26-5ee99c46497d tempest-TestMinimumBasicScenario-2054799409 None] Lock "cinder-ee0f5949-84d2-4c6e-b00e-6d038765011d-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:22 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.401s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 21:59:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 21:59:31 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:59:32 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.663s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Uploaded volume to glance image-id: f000e898-3d47-4d30-b592-f300d0cecb03. {{(pid=85936) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-7437ca79-70ff-4e11-8829-e899dc22ff1e req-d3d4c6c0-50fd-4ff9-9a7a-12e2e6591c54 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.504s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-7437ca79-70ff-4e11-8829-e899dc22ff1e req-d3d4c6c0-50fd-4ff9-9a7a-12e2e6591c54 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.040s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T19:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1616224471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34095a87-0e07-4683-8864-49afd531d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a0a98df19f4c788efd11a2381cc94e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T19:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T19:59:19Z,use_quota=True,user_id='ca02db196b3240e6942bee6b2fddec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Creating volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 21:59:35 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 21:59:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-16928c0c-1433-4715-84a8-38f8388759e8 tempest-VolumesActionsTest-835339281 None] Copy volume to image completed successfully.
Sep 16 21:59:35 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 1073741824
Sep 16 21:59:35 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-7437ca79-70ff-4e11-8829-e899dc22ff1e req-d3d4c6c0-50fd-4ff9-9a7a-12e2e6591c54 tempest-AttachVolumeNegativeTest-384733218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dadec96-eae1-4afd-a9dd-181dcab6cbd1', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 21:59:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-7437ca79-70ff-4e11-8829-e899dc22ff1e req-d3d4c6c0-50fd-4ff9-9a7a-12e2e6591c54 tempest-AttachVolumeNegativeTest-384733218 None] attachment_update completed successfully.
Sep 16 21:59:36 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 1073741824" returned: 0 in 0.682s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:36 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217
Sep 16 21:59:36 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:37 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217" returned: 0 in 0.342s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9a472b-0f38-4d14-8571-bfdba047529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34095a87-0e07-4683-8864-49afd531d217', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e40ee42-e7ef-42ec-a7f6-757b514e8128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 21:59:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Volume volume-34095a87-0e07-4683-8864-49afd531d217 (34095a87-0e07-4683-8864-49afd531d217): created successfully
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e40ee42-e7ef-42ec-a7f6-757b514e8128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Flow 'volume_create_manager' (fa33f044-2293-48e5-b684-aa82ab49545b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 21:59:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c01ec146-9ef3-4980-87d4-705b411e4165 tempest-SnapshotsActionsTest-205358966 None] Created volume successfully.
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Creating offline snapshot f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8de7ec-5e36-4087-a77c-67bd367000d7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:38 devstack sudo[98052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217
Sep 16 21:59:38 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:38 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:38 devstack sudo[98057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 1G
Sep 16 21:59:38 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-55f33da8-bfff-4e17-8c11-3774e2115ecc req-057357a7-22e8-4f44-8d84-f289f7a98501 tempest-AttachVolumeNegativeTest-384733218 None] Terminate volume connection completed successfully.
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-55f33da8-bfff-4e17-8c11-3774e2115ecc req-057357a7-22e8-4f44-8d84-f289f7a98501 tempest-AttachVolumeNegativeTest-384733218 None] Deleting attachment 6dadec96-eae1-4afd-a9dd-181dcab6cbd1. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 21:59:38 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 1G" returned: 0 in 0.512s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:38 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 21:59:38 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:39 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:39 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 is being set with open permissions: ugo+rw
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:39 devstack sudo[98095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 21:59:39 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:39 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:39 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info
Sep 16 21:59:39 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:39 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info" returned: 0 in 0.337s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:39 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info is being set with open permissions: ugo+rw
Sep 16 21:59:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:40 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info
Sep 16 21:59:40 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:40 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.info" returned: 0 in 0.446s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.461s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c1b099-5acc-4fef-9f04-7933221d2e67]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8e4790a0-46a7-4d5e-b94b-195e04a907e3 tempest-SnapshotsActionsTest-205358966 None] Create snapshot completed successfully
Sep 16 21:59:40 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:40 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:41 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.501s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:41 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb5314-ac4a-4a1e-ae4b-c9a346376e41]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:41 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:41 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:41 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.555s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:41 devstack sudo[98172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img
Sep 16 21:59:41 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:49 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img" returned: 0 in 8.232s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81a2541-9cc9-4cc2-af18-38ca3efdb23c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:49 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:49 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:50 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.582s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:59:50 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Converted 1024.00 MB image at 124.37 MB/s
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] 2a5bc4cc-9029-4749-b36c-d4c240856c38 was raw, converting to qcow2 {{(pid=85936) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4371fa2-7730-4d47-920a-e80465ee61b4]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:50 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img
Sep 16 21:59:50 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:50 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:50 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img
Sep 16 21:59:50 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:51 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img" returned: 1 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:51 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql
Sep 16 21:59:51 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:51 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Image conversion details: src /opt/stack/data/cinder/conversion/c98d0a95-fc33-41ac-9a28-8a2896ece496.temp_image.2a5bc4cc-9029-4749-b36c-d4c240856c38m0nywym7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 21:59:51 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e771b38-d38d-427a-a399-4e5e6eea2f65]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:51 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql
Sep 16 21:59:51 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:51 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_05kzh1ql" returned: 0 in 0.461s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:52 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 21:59:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.393s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Uploaded volume to glance image-id: 2a5bc4cc-9029-4749-b36c-d4c240856c38. {{(pid=85936) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 21:59:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.783s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Creating offline snapshot 3f4e631c-4d13-4728-841d-4753cb927a4e of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 21:59:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ce2a61cf-346f-4d53-b710-c4c20a57ae49 tempest-VolumesActionsTest-835339281 None] Copy volume to image completed successfully.
Sep 16 21:59:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3dd91-1b04-4a93-89c5-0d9e5a33706a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:54 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 21:59:54 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:54 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:59:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:54 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e 1G
Sep 16 21:59:54 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:55 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e 1G" returned: 0 in 0.557s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:55 devstack sudo[98256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e
Sep 16 21:59:55 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:55 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e" returned: 0 in 0.552s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:55 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e is being set with open permissions: ugo+rw
Sep 16 21:59:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:55 devstack sudo[98261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e
Sep 16 21:59:55 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:55 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e" returned: 0 in 0.372s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d1fa69a0-1783-4982-a4c3-3e1c04068710 tempest-SnapshotsActionsTest-205358966 None] Create snapshot completed successfully
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Acquiring lock "cinder-quobyte-c98d0a95-fc33-41ac-9a28-8a2896ece496" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "cinder-quobyte-c98d0a95-fc33-41ac-9a28-8a2896ece496" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[574b322d-6b6d-4069-ba75-b8c249dc8330]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:56 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:56 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:57 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.838s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:57 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496
Sep 16 21:59:57 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-3f4e631c-4d13-4728-841d-4753cb927a4e-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-3f4e631c-4d13-4728-841d-4753cb927a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-3f4e631c-4d13-4728-841d-4753cb927a4e" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-3f4e631c-4d13-4728-841d-4753cb927a4e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Deleting offline snapshot 3f4e631c-4d13-4728-841d-4753cb927a4e of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] snapshot_file for this snap is: volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[199beba8-d752-4eef-8888-6500584b3850]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:57 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e
Sep 16 21:59:57 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:57 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c98d0a95-fc33-41ac-9a28-8a2896ece496" returned: 0 in 0.688s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "cinder-quobyte-c98d0a95-fc33-41ac-9a28-8a2896ece496" released by "delete_volume" :: held 1.599s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Created reservations ['a2d0770f-9b31-47a1-be1b-6121ca22d591', '9c9e315f-07c7-4305-aed4-1a50b7a4a1ff', 'b5f91c7d-a222-41a7-8601-c00fc516dbfb', '53c44e05-d81f-4aea-aa5e-8ee2e79d4127'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:58 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e" returned: 0 in 0.601s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:59:58 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 21:59:58 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf9b08-c2ad-4980-bfae-6626c1839a12]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:58 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 21:59:58 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:58 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.512s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 21:59:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Deleted volume successfully.
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8df329bb-46e4-44e1-8cd4-4588a3d5ddd5 tempest-VolumesActionsTest-835339281 None] Lock "cinder-c98d0a95-fc33-41ac-9a28-8a2896ece496-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:58 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.538s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 21:59:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:58 devstack sudo[98353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e
Sep 16 21:59:58 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:59 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e" returned: 0 in 0.396s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 21:59:59 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e
Sep 16 21:59:59 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 21:59:59 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.3f4e631c-4d13-4728-841d-4753cb927a4e" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-3f4e631c-4d13-4728-841d-4753cb927a4e" released by "_delete_snapshot" :: held 2.013s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_snapshot" :: held 2.043s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Created reservations ['6c8894fc-4e3f-4f31-b7ee-0c9b7b913d8f', 'f87128c1-a148-4c52-b109-aaa54559c955', '44d6e5a7-44c9-4eef-8ba5-b5d3b8d7be2d', 'e2963384-c37c-4d6c-bc56-434d23aba1d5'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 21:59:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Delete snapshot completed successfully.
Sep 16 21:59:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-43e8803d-bcbd-4859-b182-ebe18b0e1499 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-3f4e631c-4d13-4728-841d-4753cb927a4e-delete_snapshot" released by "delete_snapshot" :: held 2.337s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Creating offline snapshot 5333c653-b0f5-4309-b9d5-d5f5d05a1f62 of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:00:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515c2ab-a3bc-41f9-bbee-9e97ab814f15]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:01 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:01 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:02 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.608s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:02 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 1G
Sep 16 22:00:02 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:02 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 1G" returned: 0 in 0.756s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:02 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62
Sep 16 22:00:02 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:03 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62" returned: 0 in 0.394s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:03 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 is being set with open permissions: ugo+rw
Sep 16 22:00:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:03 devstack sudo[98384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62
Sep 16 22:00:03 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:03 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62" returned: 0 in 0.308s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-efc5d7d8-4b01-4e5e-a3ff-f847ee5ddd54 tempest-SnapshotsActionsTest-205358966 None] Create snapshot completed successfully
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-5333c653-b0f5-4309-b9d5-d5f5d05a1f62-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-5333c653-b0f5-4309-b9d5-d5f5d05a1f62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_snapshot" :: waited 0.044s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-5333c653-b0f5-4309-b9d5-d5f5d05a1f62" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-5333c653-b0f5-4309-b9d5-d5f5d05a1f62" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Deleting offline snapshot 5333c653-b0f5-4309-b9d5-d5f5d05a1f62 of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] snapshot_file for this snap is: volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[084b4cfe-2b47-4490-b8c7-f5dfc04ce882]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:04 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62
Sep 16 22:00:04 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:05 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62" returned: 0 in 0.423s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2695b-9698-4a8c-a801-f057679b3279]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:05 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:05 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:05 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.598s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:05 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62
Sep 16 22:00:05 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:06 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62" returned: 0 in 0.691s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:06 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62
Sep 16 22:00:06 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:07 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.5333c653-b0f5-4309-b9d5-d5f5d05a1f62" returned: 0 in 0.448s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-5333c653-b0f5-4309-b9d5-d5f5d05a1f62" released by "_delete_snapshot" :: held 2.317s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_snapshot" :: held 2.367s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Created reservations ['a349b04e-1fec-4efa-86d0-edbfc55bf52f', 'edce2378-bd07-453c-af34-aa65d585c4a8', 'c8d87742-ac76-482f-9a0b-a5da789aafda', 'd313ee91-17a1-4612-aaac-084f770e0ae5'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Delete snapshot completed successfully.
Sep 16 22:00:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8db1be99-3e4a-4f8c-a128-38ac37f194ed tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-5333c653-b0f5-4309-b9d5-d5f5d05a1f62-delete_snapshot" released by "delete_snapshot" :: held 2.681s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Creating offline snapshot 72c8aa46-862a-49aa-b069-9456fd3bb29f of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:00:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521603e-71b3-4c5f-a15d-1b6b770320b0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:08 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:08 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:09 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.540s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:09 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f 1G
Sep 16 22:00:09 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:09 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f 1G" returned: 0 in 0.749s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:09 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f
Sep 16 22:00:09 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:10 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f" returned: 0 in 0.519s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:10 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f is being set with open permissions: ugo+rw
Sep 16 22:00:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:10 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f
Sep 16 22:00:10 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:10 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f" returned: 0 in 0.428s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:10 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6187b3b2-4c02-4d7a-a312-c78eb638f93f tempest-SnapshotsActionsTest-205358966 None] Create snapshot completed successfully
Sep 16 22:00:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-72c8aa46-862a-49aa-b069-9456fd3bb29f-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-72c8aa46-862a-49aa-b069-9456fd3bb29f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-72c8aa46-862a-49aa-b069-9456fd3bb29f" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-72c8aa46-862a-49aa-b069-9456fd3bb29f" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Deleting offline snapshot 72c8aa46-862a-49aa-b069-9456fd3bb29f of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] snapshot_file for this snap is: volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb34544-cf80-4f77-9fc4-39b76e784448]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Flow 'volume_create_manager' (e364fce7-015a-4012-bce9-3c29b07fb449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9467a1-550c-4004-8d47-20eeb39c6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:12 devstack sudo[98448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f
Sep 16 22:00:12 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9467a1-550c-4004-8d47-20eeb39c6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1149049209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bdad31-554e-45a7-8c1a-ce908db740d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3377c3025a4c6e85fcc4b1955c0748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:12Z,use_quota=True,user_id='cd3c15f990234d2bbbb0ff0ddc1d6f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c59a0d-8e50-44d6-84b0-4c283fdc8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c59a0d-8e50-44d6-84b0-4c283fdc8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3cde31-24b0-4833-8a57-37e677b8656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3cde31-24b0-4833-8a57-37e677b8656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8bdad31-554e-45a7-8c1a-ce908db740d5', 'volume_name': 'volume-a8bdad31-554e-45a7-8c1a-ce908db740d5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07421eac-a3a7-4b0f-8218-b23546e8b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07421eac-a3a7-4b0f-8218-b23546e8b92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c401188-f686-4486-8ca5-f27cfa4f2a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Volume a8bdad31-554e-45a7-8c1a-ce908db740d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8bdad31-554e-45a7-8c1a-ce908db740d5', 'volume_size': 1}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1149049209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bdad31-554e-45a7-8c1a-ce908db740d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3377c3025a4c6e85fcc4b1955c0748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:12Z,use_quota=True,user_id='cd3c15f990234d2bbbb0ff0ddc1d6f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Creating volume a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:00:12 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:12 devstack sudo[98451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 1073741824
Sep 16 22:00:12 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:12 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bd963c-dcea-4391-994a-fa09464f204f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:12 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:12 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:12 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 1073741824" returned: 0 in 0.530s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:12 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:12 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:13 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.432s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:13 devstack sudo[98466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f
Sep 16 22:00:13 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:13 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c401188-f686-4486-8ca5-f27cfa4f2a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bdad31-554e-45a7-8c1a-ce908db740d5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c8597-aae3-44b2-9e78-d34d8fe68c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Volume volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 (a8bdad31-554e-45a7-8c1a-ce908db740d5): created successfully
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39c8597-aae3-44b2-9e78-d34d8fe68c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Flow 'volume_create_manager' (e364fce7-015a-4012-bce9-3c29b07fb449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-33b153d1-3ceb-4292-adad-23bc8327de03 tempest-TestImageHashVerification-417060626 None] Created volume successfully.
Sep 16 22:00:13 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f" returned: 0 in 0.424s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:13 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f
Sep 16 22:00:13 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:13 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.72c8aa46-862a-49aa-b069-9456fd3bb29f" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-72c8aa46-862a-49aa-b069-9456fd3bb29f" released by "_delete_snapshot" :: held 1.767s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_snapshot" :: held 1.819s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Created reservations ['affabf82-b6e9-4da5-884f-1daf2a03e535', '5fbb7209-5ab4-4ae4-adc8-e7d465ced102', '69b97fad-013d-4b6f-a262-377b931cb03e', 'f486212b-54c5-4ebe-b9eb-4b029904abde'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Delete snapshot completed successfully.
Sep 16 22:00:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0a2bada1-7397-47be-bc69-c8eade83eae2 tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-72c8aa46-862a-49aa-b069-9456fd3bb29f-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Flow 'volume_create_manager' (f6e91f66-10b0-48b5-83be-e6f1e52bcc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be72e012-b190-482e-b7c6-096265e7e308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be72e012-b190-482e-b7c6-096265e7e308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1322230247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fa8220-36fa-4c9c-908d-94e125a2282b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8d7f4a517942ffb96f262c10afa7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:14Z,use_quota=True,user_id='2a9a2efab8b5454a80049f5157ec7ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faaa68-dd6f-4cd9-8923-491bc3eab167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faaa68-dd6f-4cd9-8923-491bc3eab167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448e14b-fa87-4e38-b606-d061fb7eb41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448e14b-fa87-4e38-b606-d061fb7eb41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fa8220-36fa-4c9c-908d-94e125a2282b', 'volume_name': 'volume-23fa8220-36fa-4c9c-908d-94e125a2282b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234ac7f5-7833-4f8a-8381-c4ac271b4870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234ac7f5-7833-4f8a-8381-c4ac271b4870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24110fb-d161-44aa-ba61-abe44bb8bc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Volume 23fa8220-36fa-4c9c-908d-94e125a2282b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fa8220-36fa-4c9c-908d-94e125a2282b', 'volume_size': 1}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1322230247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fa8220-36fa-4c9c-908d-94e125a2282b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8d7f4a517942ffb96f262c10afa7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:14Z,use_quota=True,user_id='2a9a2efab8b5454a80049f5157ec7ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Creating volume 23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:00:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:14 devstack sudo[98477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b 1073741824
Sep 16 22:00:14 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:14 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b 1073741824" returned: 0 in 0.460s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:14 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:00:14 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:15 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24110fb-d161-44aa-ba61-abe44bb8bc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fa8220-36fa-4c9c-908d-94e125a2282b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505e6bf9-72e7-4815-abd0-cb3e43e33076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Creating offline snapshot 9d169bb3-b95c-4465-abcd-2d3f3b202c9a of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:00:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Volume volume-23fa8220-36fa-4c9c-908d-94e125a2282b (23fa8220-36fa-4c9c-908d-94e125a2282b): created successfully
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505e6bf9-72e7-4815-abd0-cb3e43e33076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Flow 'volume_create_manager' (f6e91f66-10b0-48b5-83be-e6f1e52bcc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e3eeed-51ed-4dad-a507-47ad1f0015d8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1e5d062f-dd75-41f1-9f05-3b563644d179 tempest-VolumesCloneTest-1555146755 None] Created volume successfully.
Sep 16 22:00:15 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:15 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:15 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:15 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a 1G
Sep 16 22:00:15 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:16 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a 1G" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:16 devstack sudo[98495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a
Sep 16 22:00:16 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:16 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a" returned: 0 in 0.300s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:16 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a is being set with open permissions: ugo+rw
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:16 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a
Sep 16 22:00:16 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:16 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.449s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.512s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f97b50f-d317-4283-84f7-cfed1658f391]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cd42290b-39b2-4da2-a137-7b225bcc9136 tempest-SnapshotsActionsTest-205358966 None] Create snapshot completed successfully
Sep 16 22:00:16 devstack sudo[98503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:16 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Flow 'volume_create_manager' (6c4f3b21-89c0-4a6a-9b9e-d36e144e1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26fbe2-3579-43c1-8bb7-6dc915b594ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26fbe2-3579-43c1-8bb7-6dc915b594ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-526439549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118da838-7f16-4314-aaac-429b0f6f372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8d7f4a517942ffb96f262c10afa7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=23fa8220-36fa-4c9c-908d-94e125a2282b,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:17Z,use_quota=True,user_id='2a9a2efab8b5454a80049f5157ec7ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6276287b-3413-43d7-8abc-cd3dbea8f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6276287b-3413-43d7-8abc-cd3dbea8f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dce56f-0880-458b-937d-48f1fc9c8f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78dce56f-0880-458b-937d-48f1fc9c8f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '118da838-7f16-4314-aaac-429b0f6f372b', 'volume_name': 'volume-118da838-7f16-4314-aaac-429b0f6f372b', 'volume_size': 2, 'source_volid': '23fa8220-36fa-4c9c-908d-94e125a2282b', 'source_volstatus': 'available'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d536d-ceab-4766-a158-ae920b12bb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985d536d-ceab-4766-a158-ae920b12bb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae3a0c-29e4-4ecd-9d65-7f5bec9c4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Volume 118da838-7f16-4314-aaac-429b0f6f372b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-118da838-7f16-4314-aaac-429b0f6f372b', 'volume_size': 2, 'source_volid': '23fa8220-36fa-4c9c-908d-94e125a2282b', 'source_volstatus': 'available'}
Sep 16 22:00:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:17 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[075141d6-a066-472e-a7f2-6b85c77d9aad]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:17 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:17 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:17 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 /opt/stack/data/cinder/conversion/a8bdad31-554e-45a7-8c1a-ce908db740d5.temp_image.0175928a-551c-4875-b2dc-e64682593567g8611qau.img {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:17 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 /opt/stack/data/cinder/conversion/a8bdad31-554e-45a7-8c1a-ce908db740d5.temp_image.0175928a-551c-4875-b2dc-e64682593567g8611qau.img
Sep 16 22:00:17 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-9d169bb3-b95c-4465-abcd-2d3f3b202c9a-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-9d169bb3-b95c-4465-abcd-2d3f3b202c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Acquiring lock "cinder-quobyte-9d169bb3-b95c-4465-abcd-2d3f3b202c9a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-9d169bb3-b95c-4465-abcd-2d3f3b202c9a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Deleting offline snapshot 9d169bb3-b95c-4465-abcd-2d3f3b202c9a of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] snapshot_file for this snap is: volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eca3ee-96f6-4daf-a0da-042a1ecf6d81]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:17 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a
Sep 16 22:00:17 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:18 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a" returned: 0 in 0.790s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ce74f-9ee4-47a4-993c-1feaa9e2c089]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:18 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:18 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:19 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.594s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:19 devstack sudo[98537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a
Sep 16 22:00:19 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:20 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a" returned: 0 in 0.862s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:20 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a
Sep 16 22:00:20 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:20 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.9d169bb3-b95c-4465-abcd-2d3f3b202c9a" returned: 0 in 0.362s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-9d169bb3-b95c-4465-abcd-2d3f3b202c9a" released by "_delete_snapshot" :: held 2.824s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_snapshot" :: held 2.857s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Created reservations ['10ed48f9-4770-4b15-aecc-ed9df6ed077a', '92e44a7c-4c38-433f-b966-62a8bc0baec8', 'ead275e2-e526-4ca0-aa58-86808f84e2b3', 'c18820f6-a6e9-4801-b08f-58ac88dfda0c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Delete snapshot completed successfully.
Sep 16 22:00:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2bd8ebbe-b837-4294-90c4-a1d41874426c tempest-SnapshotsActionsTest-560883728 None] Lock "cinder-9d169bb3-b95c-4465-abcd-2d3f3b202c9a-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "cinder-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "cinder-quobyte-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Deleting offline snapshot f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 of volume 34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] snapshot_file for this snap is: volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7897f38-55e5-41cd-804e-43a05f17c2ff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:22 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:00:22 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (c63d630a-62ca-4655-9c02-e8cdfcaa0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b330ba64-9b4f-44cc-8a2d-6f391c7ba520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b330ba64-9b4f-44cc-8a2d-6f391c7ba520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357171478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c81475e-676b-4a83-969d-8d9697c047e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:22Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c1abe7-59a3-45ee-8c42-4db271fd0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c1abe7-59a3-45ee-8c42-4db271fd0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13060ee-6c25-4460-9046-4f0d3314a07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13060ee-6c25-4460-9046-4f0d3314a07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c81475e-676b-4a83-969d-8d9697c047e8', 'volume_name': 'volume-4c81475e-676b-4a83-969d-8d9697c047e8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:22 devstack sudo[98551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:22 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d75c600-40a9-472d-b11a-393334e3b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d75c600-40a9-472d-b11a-393334e3b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5a9a5d-0e65-41a1-96e3-a8a2c9ecb807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:22 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Volume 4c81475e-676b-4a83-969d-8d9697c047e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c81475e-676b-4a83-969d-8d9697c047e8', 'volume_size': 1}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:22 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.480s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:00:22 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.752s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34095a87-0e07-4683-8864-49afd531d217(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4fbe5-8539-4ede-9a80-84c14e67261d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:22 devstack sudo[98561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217
Sep 16 22:00:22 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:23 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217" returned: 0 in 0.583s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:23 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:23 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:24 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.588s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:24 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8
Sep 16 22:00:24 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:24 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217.f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8" released by "_delete_snapshot" :: held 2.606s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_snapshot" :: held 2.658s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Created reservations ['737f0775-9aec-44af-8588-034e3de7fe3b', '687e45aa-a5dd-4f2e-96eb-602fbf124186', 'b2ecfb64-54c1-4c93-938c-7178c47a33b1', '5f91fd70-0e91-4d65-8133-907067d035b1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Delete snapshot completed successfully.
Sep 16 22:00:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9f6e9443-f49b-4661-a4bc-b4aaf4d8b5c4 tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-f0b188b5-ab9b-4b8d-b25b-503dcd295ae8-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:25 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 /opt/stack/data/cinder/conversion/a8bdad31-554e-45a7-8c1a-ce908db740d5.temp_image.0175928a-551c-4875-b2dc-e64682593567g8611qau.img" returned: 0 in 7.701s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd65c3b-ae7c-4214-bf8d-8283488ac91f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "cinder-34095a87-0e07-4683-8864-49afd531d217-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-34095a87-0e07-4683-8864-49afd531d217-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:25 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:25 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e318a0-509a-4f49-a61a-aca7e2dc8261]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:25 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217
Sep 16 22:00:25 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:25 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217" returned: 0 in 0.412s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:25 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217
Sep 16 22:00:25 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:25 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.637s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/conversion/a8bdad31-554e-45a7-8c1a-ce908db740d5.temp_image.0175928a-551c-4875-b2dc-e64682593567g8611qau.img {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:00:25 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Converted 1024.00 MB image at 132.95 MB/s
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] 0175928a-551c-4875-b2dc-e64682593567 was raw, no need to convert to raw {{(pid=85936) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 22:00:25 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-34095a87-0e07-4683-8864-49afd531d217" returned: 0 in 0.282s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-quobyte-34095a87-0e07-4683-8864-49afd531d217" released by "delete_volume" :: held 0.778s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Created reservations ['14782202-768c-4d82-9254-a25b6c5c7bcc', '14ee8cb2-9a97-4bb4-901d-5078fc70cb66', '4355f049-9bba-4e8e-b3f9-9acb50f3bb25', '65697559-1a15-4afe-ae08-a38acea9b83d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:26 devstack sudo[98596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:00:26 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:26 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:00:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Deleted volume successfully.
Sep 16 22:00:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-578e125f-b462-4977-b859-873df582257c tempest-SnapshotsActionsTest-205358966 None] Lock "cinder-34095a87-0e07-4683-8864-49afd531d217-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=58,cinder:SELECT=69,cinder:DELETE=7,cinder:INSERT=17 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Flow 'volume_create_manager' (b1a02b93-3ec7-44bf-875d-7eb5b3469118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382809e-51b5-4de5-bf2b-2d065a9f23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382809e-51b5-4de5-bf2b-2d065a9f23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2123321521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cd622c-a9a8-4c8a-9c65-0bc1ec07f521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864b688ed4cd4bd5853e1b3c31acfc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:33Z,use_quota=True,user_id='374efcdf9c24425697c2edde47ad280d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9da964-eea2-4699-be80-9821c79a0c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9da964-eea2-4699-be80-9821c79a0c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44183cf6-0f65-4323-9695-93dfc32fdf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44183cf6-0f65-4323-9695-93dfc32fdf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03cd622c-a9a8-4c8a-9c65-0bc1ec07f521', 'volume_name': 'volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46532b1e-eb6d-4799-bb71-b07fc7456444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46532b1e-eb6d-4799-bb71-b07fc7456444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5d0a15-3867-4eeb-8a87-a12fdd8fd21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:32 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Volume 03cd622c-a9a8-4c8a-9c65-0bc1ec07f521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521', 'volume_size': 1}
Sep 16 22:00:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:42 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:INSERT=13,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Uploaded volume to glance image-id: 0175928a-551c-4875-b2dc-e64682593567. {{(pid=85936) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 28.664s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:45 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Cloning volume 23fa8220-36fa-4c9c-908d-94e125a2282b to volume 118da838-7f16-4314-aaac-429b0f6f372b
Sep 16 22:00:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d2638ebf-3ac1-4916-b0ba-21bd885d534b tempest-TestImageHashVerification-417060626 None] Copy volume to image completed successfully.
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Creating offline snapshot 91be2648-9de5-413d-8eba-73983c6bef5a of volume 23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c3d28-74e8-4eb8-8dbc-9c0e63e5713e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:45 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:00:45 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:46 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:46 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a 1G
Sep 16 22:00:46 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:46 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a 1G" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fa8220-36fa-4c9c-908d-94e125a2282b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:46 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fa8220-36fa-4c9c-908d-94e125a2282b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:46 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:46 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fa8220-36fa-4c9c-908d-94e125a2282b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a is being set with open permissions: ugo+rw
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:46 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:46 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Acquiring lock "cinder-a8bdad31-554e-45a7-8c1a-ce908db740d5-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "cinder-a8bdad31-554e-45a7-8c1a-ce908db740d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Acquiring lock "cinder-quobyte-a8bdad31-554e-45a7-8c1a-ce908db740d5" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "cinder-quobyte-a8bdad31-554e-45a7-8c1a-ce908db740d5" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[16724d9f-6c1d-4fda-8d03-4e0394cea684]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:47 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:47 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info
Sep 16 22:00:47 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:47 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:47 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info is being set with open permissions: ugo+rw
Sep 16 22:00:47 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info
Sep 16 22:00:47 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:47 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a8bdad31-554e-45a7-8c1a-ce908db740d5" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "cinder-quobyte-a8bdad31-554e-45a7-8c1a-ce908db740d5" released by "delete_volume" :: held 0.675s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:47 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.info" returned: 0 in 0.253s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] snapshot: 91be2648-9de5-413d-8eba-73983c6bef5a, volume: 118da838-7f16-4314-aaac-429b0f6f372b,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a445d-1fa4-4ca7-8dc8-fa5c9d0f7532]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Created reservations ['6b31e3a1-75c6-453f-af5c-55da784a78b1', 'e72538d9-904a-43cb-98d7-2feb8390d962', 'e8aaf848-e6d7-4338-895f-72c5a3871bb7', '2a23deda-03c5-46d8-9f2a-9d23aa344cff'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:47 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:47 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:47 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:00:47 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:48 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:00:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Deleted volume successfully.
Sep 16 22:00:48 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2826288b-31ac-42a9-985c-d2e11ce96a98 tempest-TestImageHashVerification-417060626 None] Lock "cinder-a8bdad31-554e-45a7-8c1a-ce908db740d5-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.395s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23fa8220-36fa-4c9c-908d-94e125a2282b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[212de705-3d65-4bf5-a640-db3cf219c909]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:48 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:00:48 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:48 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.367s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:00:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:48 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b
Sep 16 22:00:48 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:55 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b" returned: 0 in 7.419s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:55 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:00:55 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Converted 1024.00 MB image at 138.01 MB/s
Sep 16 22:00:55 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b is being set with open permissions: ugo+rw
Sep 16 22:00:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:55 devstack sudo[98710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b
Sep 16 22:00:55 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:56 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" released by "_copy_volume_from_snapshot" :: held 8.516s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-quobyte-91be2648-9de5-413d-8eba-73983c6bef5a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-91be2648-9de5-413d-8eba-73983c6bef5a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Deleting offline snapshot 91be2648-9de5-413d-8eba-73983c6bef5a of volume 23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] snapshot_file for this snap is: volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f6cb8-8874-4ed1-9bf1-44fec39de840]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:56 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:56 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:56 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23fa8220-36fa-4c9c-908d-94e125a2282b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f9ddc4-5dc2-4db5-9163-6f14bfd96af9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:56 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:00:56 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:57 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.565s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:57 devstack sudo[98723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:57 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:57 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.330s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:57 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a
Sep 16 22:00:57 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:57 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b.91be2648-9de5-413d-8eba-73983c6bef5a" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-91be2648-9de5-413d-8eba-73983c6bef5a" released by "_delete_snapshot" :: held 1.677s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.274s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.570s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1357171478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c81475e-676b-4a83-969d-8d9697c047e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d996c297d74ebc886259454845ce44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:22Z,use_quota=True,user_id='617832b98ce34732a6b06b68b6e40169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Creating volume 4c81475e-676b-4a83-969d-8d9697c047e8 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:00:57 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:57 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 1073741824
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae3a0c-29e4-4ecd-9d65-7f5bec9c4628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118da838-7f16-4314-aaac-429b0f6f372b', 'volume_size': 2, 'source_volid': '23fa8220-36fa-4c9c-908d-94e125a2282b', 'source_volstatus': 'available'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:57 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d334d689-48d5-4528-b0f3-4d324a7d9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:57 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Volume volume-118da838-7f16-4314-aaac-429b0f6f372b (118da838-7f16-4314-aaac-429b0f6f372b): created successfully
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d334d689-48d5-4528-b0f3-4d324a7d9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Flow 'volume_create_manager' (6c4f3b21-89c0-4a6a-9b9e-d36e144e1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-53e7f071-34fa-4fde-8f26-5627c284bf0e tempest-VolumesCloneTest-1555146755 None] Created volume successfully.
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-118da838-7f16-4314-aaac-429b0f6f372b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:58 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 1073741824" returned: 0 in 0.528s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "cinder-118da838-7f16-4314-aaac-429b0f6f372b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:58 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8
Sep 16 22:00:58 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b07d8-3ff9-4e1a-baa6-edca2ebcf7b2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:58 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b
Sep 16 22:00:58 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:58 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8" returned: 0 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.881s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2123321521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03cd622c-a9a8-4c8a-9c65-0bc1ec07f521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864b688ed4cd4bd5853e1b3c31acfc95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:00:33Z,use_quota=True,user_id='374efcdf9c24425697c2edde47ad280d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Creating volume 03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:00:58 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5a9a5d-0e65-41a1-96e3-a8a2c9ecb807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c81475e-676b-4a83-969d-8d9697c047e8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a60233e-626a-447d-b422-a52a59a4ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:58 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 1073741824
Sep 16 22:00:58 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Volume volume-4c81475e-676b-4a83-969d-8d9697c047e8 (4c81475e-676b-4a83-969d-8d9697c047e8): created successfully
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a60233e-626a-447d-b422-a52a59a4ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Flow 'volume_create_manager' (c63d630a-62ca-4655-9c02-e8cdfcaa0731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-58e441fd-7fc4-4381-ba8a-9ce047d9b423 tempest-AttachVolumeNegativeTest-384733218 None] Created volume successfully.
Sep 16 22:00:59 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:59 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b
Sep 16 22:00:59 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:59 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-118da838-7f16-4314-aaac-429b0f6f372b" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:59 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 1073741824" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-118da838-7f16-4314-aaac-429b0f6f372b" released by "delete_volume" :: held 0.801s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:59 devstack sudo[98756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521
Sep 16 22:00:59 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Created reservations ['df8a875c-9e5e-40f2-b338-f6aff09ed201', '1fa484d2-cf1d-47ac-96c8-6c67dbdfc10d', 'dcea1cc2-6196-4d3b-b313-7e0fb69117f3', '5230ed79-3e88-4fab-8ac6-98265aab7ead'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:00:59 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:00:59 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:00:59 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5d0a15-3867-4eeb-8a87-a12fdd8fd21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114938be-6c24-4ec9-80f3-50471049c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-23fa8220-36fa-4c9c-908d-94e125a2282b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Volume volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 (03cd622c-a9a8-4c8a-9c65-0bc1ec07f521): created successfully
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114938be-6c24-4ec9-80f3-50471049c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Flow 'volume_create_manager' (b1a02b93-3ec7-44bf-875d-7eb5b3469118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "cinder-23fa8220-36fa-4c9c-908d-94e125a2282b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:00:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-89d7f1ac-54ca-41d6-94e0-f7cc41d6517e tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Created volume successfully.
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Acquiring lock "cinder-quobyte-23fa8220-36fa-4c9c-908d-94e125a2282b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:00:59 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:00:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Deleted volume successfully.
Sep 16 22:00:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-23fa8220-36fa-4c9c-908d-94e125a2282b" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a70a51-34b5-48a7-bd9d-e2250b42dfd5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d158b823-95a8-4b40-8fa7-47f2432c48db tempest-VolumesCloneTest-1555146755 None] Lock "cinder-118da838-7f16-4314-aaac-429b0f6f372b-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:00 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:01:00 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:00 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.474s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:00 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b
Sep 16 22:01:00 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:00 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9eb522fc-4768-4c07-a919-079892ad1661 req-f0bcf08b-8c31-4c03-97d6-34a931f55b72 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9eb522fc-4768-4c07-a919-079892ad1661 req-f0bcf08b-8c31-4c03-97d6-34a931f55b72 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-23fa8220-36fa-4c9c-908d-94e125a2282b" returned: 0 in 0.358s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "cinder-quobyte-23fa8220-36fa-4c9c-908d-94e125a2282b" released by "delete_volume" :: held 0.926s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-9eb522fc-4768-4c07-a919-079892ad1661 req-f0bcf08b-8c31-4c03-97d6-34a931f55b72 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-9eb522fc-4768-4c07-a919-079892ad1661 req-f0bcf08b-8c31-4c03-97d6-34a931f55b72 tempest-AttachVolumeNegativeTest-384733218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-4c81475e-676b-4a83-969d-8d9697c047e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f605a94-6b5f-41c3-b04a-42d154cb238c', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:01:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Created reservations ['12f04bcb-dc99-40f0-82c2-b842a95d5046', '7b973546-6040-46a0-8b8a-f59c53cd82dc', 'f83ad2b3-7125-4b7a-a75b-18fc44c013dd', 'c576331d-3f06-4c05-9059-1f988f8e7989'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-9eb522fc-4768-4c07-a919-079892ad1661 req-f0bcf08b-8c31-4c03-97d6-34a931f55b72 tempest-AttachVolumeNegativeTest-384733218 None] attachment_update completed successfully.
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:01 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:01 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:01 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Deleted volume successfully.
Sep 16 22:01:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b04f7788-58b0-475f-b578-1f2adc535d06 tempest-VolumesCloneTest-1555146755 None] Lock "cinder-23fa8220-36fa-4c9c-908d-94e125a2282b-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Acquiring lock "cinder-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "cinder-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Acquiring lock "cinder-quobyte-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "cinder-quobyte-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1533b62-68d8-43d4-8cb1-ae78d60635c7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:02 devstack sudo[99198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521
Sep 16 22:01:02 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:02 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" returned: 0 in 0.456s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:02 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521
Sep 16 22:01:02 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:03 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" returned: 0 in 0.326s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "cinder-quobyte-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521" released by "delete_volume" :: held 0.847s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Created reservations ['21cc0c2d-c206-45bd-9eaa-931aa1665094', 'e42faf59-3249-4e9b-ac37-d1ffc0cb6157', 'e03c9472-62e5-48e5-8e6b-1b8fa0a044f6', '5c6213cc-f6a1-4a7c-a1a5-7e084ca800ed'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:03 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:03 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (bbc2aad0-14c0-4ae0-9e84-e3313eb36f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21eeb255-5ce6-4420-afcc-2b4e225c0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21eeb255-5ce6-4420-afcc-2b4e225c0867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679741102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bfdea6-747b-4bd8-a68a-c4916dd434f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:03Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e5598a-e916-401d-843c-164b5d6a8cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e5598a-e916-401d-843c-164b5d6a8cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc1add-c199-4c6b-82fb-59bf8b29788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc1add-c199-4c6b-82fb-59bf8b29788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4bfdea6-747b-4bd8-a68a-c4916dd434f3', 'volume_name': 'volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8ee32d-a19a-41dd-afb3-d1c025df464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8ee32d-a19a-41dd-afb3-d1c025df464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe3ee4-6e9b-48dd-8390-e9b73e0587e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume c4bfdea6-747b-4bd8-a68a-c4916dd434f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3', 'volume_size': 1}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679741102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bfdea6-747b-4bd8-a68a-c4916dd434f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:03Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume c4bfdea6-747b-4bd8-a68a-c4916dd434f3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:03 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 1073741824
Sep 16 22:01:03 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:03 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Deleted volume successfully.
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-24b5aff0-08fd-441e-9a9c-94c7af8525c6 tempest-VolumeQuotasNegativeTestJSON-1424467210 None] Lock "cinder-03cd622c-a9a8-4c8a-9c65-0bc1ec07f521-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-ccd2670f-4ed8-469a-b10d-7a65aecd756c req-43c25a3f-ec57-45d6-8ba5-feff8ec95281 tempest-AttachVolumeNegativeTest-384733218 None] Terminate volume connection completed successfully.
Sep 16 22:01:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-ccd2670f-4ed8-469a-b10d-7a65aecd756c req-43c25a3f-ec57-45d6-8ba5-feff8ec95281 tempest-AttachVolumeNegativeTest-384733218 None] Deleting attachment 8f605a94-6b5f-41c3-b04a-42d154cb238c. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:01:04 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 1073741824" returned: 0 in 0.578s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:04 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3
Sep 16 22:01:04 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:04 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe3ee4-6e9b-48dd-8390-e9b73e0587e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e3f46a-1e22-4668-ae3c-59a247e5a249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 (c4bfdea6-747b-4bd8-a68a-c4916dd434f3): created successfully
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e3f46a-1e22-4668-ae3c-59a247e5a249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (bbc2aad0-14c0-4ae0-9e84-e3313eb36f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-397cbe1c-2b22-4261-aaa1-e4b3101fce1c tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (8ee55190-8df0-40e0-a0ca-27dc9837992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4064607-4081-43fc-a444-e60b202156c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4064607-4081-43fc-a444-e60b202156c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412273068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228cc4f5-326e-4599-905f-8b0593d36f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:06Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b0cb86-d34e-4bf1-abd1-873600861e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b0cb86-d34e-4bf1-abd1-873600861e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ec45c3-b79b-402c-a51c-f0d1bba3488e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ec45c3-b79b-402c-a51c-f0d1bba3488e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228cc4f5-326e-4599-905f-8b0593d36f02', 'volume_name': 'volume-228cc4f5-326e-4599-905f-8b0593d36f02', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb0f6f-9db4-4271-8f08-8bab536a31bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb0f6f-9db4-4271-8f08-8bab536a31bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb0655-d409-4d7d-a01d-3fc41f87f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume 228cc4f5-326e-4599-905f-8b0593d36f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228cc4f5-326e-4599-905f-8b0593d36f02', 'volume_size': 1}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412273068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228cc4f5-326e-4599-905f-8b0593d36f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:06Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume 228cc4f5-326e-4599-905f-8b0593d36f02 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:06 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:06 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 1073741824
Sep 16 22:01:06 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (4ebf483c-463e-4396-8cef-021360681d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d968b561-330f-4850-8bcb-8da05c8b3472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d968b561-330f-4850-8bcb-8da05c8b3472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785434166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e78fd1-34c8-424e-96b8-2cb9b760455d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:07Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89d69d6-52b5-41b7-b8c1-cde26722a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89d69d6-52b5-41b7-b8c1-cde26722a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cd2df-d0b2-4164-901d-8a5628c1da06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cd2df-d0b2-4164-901d-8a5628c1da06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e78fd1-34c8-424e-96b8-2cb9b760455d', 'volume_name': 'volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a03528-f9f7-42c5-a651-8b5cf76f93a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a03528-f9f7-42c5-a651-8b5cf76f93a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3eeca6-58c9-4646-9ee4-60a1ea287f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume b9e78fd1-34c8-424e-96b8-2cb9b760455d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d', 'volume_size': 1}
Sep 16 22:01:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:07 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 1073741824" returned: 0 in 0.844s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:07 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02
Sep 16 22:01:07 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (acd06b19-b670-4a27-9ba7-39b59dacb371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393de75-b099-4eff-8b9f-195cc0d13f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393de75-b099-4eff-8b9f-195cc0d13f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-162506105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ab19c-410e-488c-95a6-40e2f4e6ef2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f59c78-6bce-4bb5-b949-4e177ddbfb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f59c78-6bce-4bb5-b949-4e177ddbfb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09350a2-b198-4f73-8f51-4d6d84f6d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09350a2-b198-4f73-8f51-4d6d84f6d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158ab19c-410e-488c-95a6-40e2f4e6ef2b', 'volume_name': 'volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eccf27-771f-4b6e-a26a-4baf4562de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eccf27-771f-4b6e-a26a-4baf4562de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f05bd2-3692-44f7-9885-8d1659ed96b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume 158ab19c-410e-488c-95a6-40e2f4e6ef2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b', 'volume_size': 1}
Sep 16 22:01:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:08 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02" returned: 0 in 0.547s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.102s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1785434166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e78fd1-34c8-424e-96b8-2cb9b760455d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:07Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume b9e78fd1-34c8-424e-96b8-2cb9b760455d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb0655-d409-4d7d-a01d-3fc41f87f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228cc4f5-326e-4599-905f-8b0593d36f02', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d 1073741824
Sep 16 22:01:08 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae08dd8-51c3-4e95-899f-63633cf2e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-228cc4f5-326e-4599-905f-8b0593d36f02 (228cc4f5-326e-4599-905f-8b0593d36f02): created successfully
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae08dd8-51c3-4e95-899f-63633cf2e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (8ee55190-8df0-40e0-a0ca-27dc9837992c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bbf39cd2-d420-43d7-9d71-102a3de18783 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (e1696c83-b274-4842-90c9-974fc8287147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654debd2-aa99-44b6-802b-fc8fc2fd12fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Flow 'volume_create_manager' (05f704d9-4306-4c9e-b573-e0f23a2e6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5623d63-0679-49e0-95c0-32a8e9dcff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654debd2-aa99-44b6-802b-fc8fc2fd12fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-107274995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54fc294-6110-4db2-9912-3e592c4f1084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90727b4-4374-419a-a296-ee2c1cb71a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90727b4-4374-419a-a296-ee2c1cb71a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afece4b-d3d5-471e-9608-5bb4ee6290bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afece4b-d3d5-471e-9608-5bb4ee6290bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd54fc294-6110-4db2-9912-3e592c4f1084', 'volume_name': 'volume-d54fc294-6110-4db2-9912-3e592c4f1084', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c6cfe6-92da-471d-ab9b-ec682f162891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c6cfe6-92da-471d-ab9b-ec682f162891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f3a36-0131-46b5-a5b3-733286ac1eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume d54fc294-6110-4db2-9912-3e592c4f1084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d54fc294-6110-4db2-9912-3e592c4f1084', 'volume_size': 1}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5623d63-0679-49e0-95c0-32a8e9dcff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-782029925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfddbff-77ad-4a70-89e5-0a103ff18893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55702e93ea6c4de985606c8e8072b2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='925085d8b69a48af92b4c784b61d274e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cf72e1-1ed9-4c7c-9acd-2b04815e0ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cf72e1-1ed9-4c7c-9acd-2b04815e0ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48edb634-1209-4545-b878-074dbbd9d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48edb634-1209-4545-b878-074dbbd9d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfddbff-77ad-4a70-89e5-0a103ff18893', 'volume_name': 'volume-bbfddbff-77ad-4a70-89e5-0a103ff18893', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e3acec-f3a4-464e-bfe3-2010a7969c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e3acec-f3a4-464e-bfe3-2010a7969c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6f6701-1e00-444b-acb5-d331a3eed0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Volume bbfddbff-77ad-4a70-89e5-0a103ff18893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfddbff-77ad-4a70-89e5-0a103ff18893', 'volume_size': 1}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (77c27138-d0a3-4e7a-a07e-573ba78aea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac75ae3a-1d8c-4460-a3e5-32170fb9ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac75ae3a-1d8c-4460-a3e5-32170fb9ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742694872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eb4727-72ce-476a-a37a-1672bb4c42ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:09Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2e997-3173-4114-9ce2-f60385efcdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b2e997-3173-4114-9ce2-f60385efcdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6017c1f1-c54e-45c3-b195-16ecb96b56d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6017c1f1-c54e-45c3-b195-16ecb96b56d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21eb4727-72ce-476a-a37a-1672bb4c42ca', 'volume_name': 'volume-21eb4727-72ce-476a-a37a-1672bb4c42ca', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f19953b-865e-40c1-a8c5-0fed3628fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f19953b-865e-40c1-a8c5-0fed3628fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb2d57c-65e5-445e-9951-e1749bc8f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume 21eb4727-72ce-476a-a37a-1672bb4c42ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21eb4727-72ce-476a-a37a-1672bb4c42ca', 'volume_size': 1}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:08 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d 1073741824" returned: 0 in 0.843s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:08 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d
Sep 16 22:01:08 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:09 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-162506105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158ab19c-410e-488c-95a6-40e2f4e6ef2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume 158ab19c-410e-488c-95a6-40e2f4e6ef2b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:09 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3eeca6-58c9-4646-9ee4-60a1ea287f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb09f6-9f49-4dfa-b60f-e23f486f9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:09 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b 1073741824
Sep 16 22:01:09 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d (b9e78fd1-34c8-424e-96b8-2cb9b760455d): created successfully
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb09f6-9f49-4dfa-b60f-e23f486f9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (4ebf483c-463e-4396-8cef-021360681d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5261f408-f646-49c7-85a6-12db47fb4b64 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:09 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b 1073741824" returned: 0 in 0.531s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:09 devstack sudo[99298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b
Sep 16 22:01:09 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:10 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-107274995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54fc294-6110-4db2-9912-3e592c4f1084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume d54fc294-6110-4db2-9912-3e592c4f1084 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:10 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f05bd2-3692-44f7-9885-8d1659ed96b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:10 devstack sudo[99301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 1073741824
Sep 16 22:01:10 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec65dfb-1f7c-489b-b125-5d7f360a3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:10 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b (158ab19c-410e-488c-95a6-40e2f4e6ef2b): created successfully
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec65dfb-1f7c-489b-b125-5d7f360a3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (acd06b19-b670-4a27-9ba7-39b59dacb371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:10 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ebe7e49b-c829-40d2-8608-c5f19d805e14 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:10 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 1073741824" returned: 0 in 0.514s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:10 devstack sudo[99307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084
Sep 16 22:01:10 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-4c81475e-676b-4a83-969d-8d9697c047e8-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-4c81475e-676b-4a83-969d-8d9697c047e8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-quobyte-4c81475e-676b-4a83-969d-8d9697c047e8" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-4c81475e-676b-4a83-969d-8d9697c047e8" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b611c38-60e7-4199-9556-8db240d65a9c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-782029925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfddbff-77ad-4a70-89e5-0a103ff18893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55702e93ea6c4de985606c8e8072b2b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:08Z,use_quota=True,user_id='925085d8b69a48af92b4c784b61d274e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Creating volume bbfddbff-77ad-4a70-89e5-0a103ff18893 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f3a36-0131-46b5-a5b3-733286ac1eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54fc294-6110-4db2-9912-3e592c4f1084', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68dbc28-de14-4219-bf7f-c6da3672ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:11 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 1073741824
Sep 16 22:01:11 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-d54fc294-6110-4db2-9912-3e592c4f1084 (d54fc294-6110-4db2-9912-3e592c4f1084): created successfully
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68dbc28-de14-4219-bf7f-c6da3672ba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (e1696c83-b274-4842-90c9-974fc8287147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:11 devstack sudo[99310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8
Sep 16 22:01:11 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2b43e185-8556-495c-82f2-f6daf86267cb tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:11 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8" returned: 0 in 0.414s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8
Sep 16 22:01:11 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 1073741824" returned: 0 in 0.509s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893
Sep 16 22:01:11 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4c81475e-676b-4a83-969d-8d9697c047e8" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-4c81475e-676b-4a83-969d-8d9697c047e8" released by "delete_volume" :: held 0.749s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Created reservations ['68111a73-73a9-4288-a7f3-276d0657d602', 'e00b909d-881f-4275-93e2-7206f848fd99', 'f9963d6a-269b-4c6d-8ba3-d4713c20b5fc', '371f3b34-6391-4f64-acb6-069a4dd72d4d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:11 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.023s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742694872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21eb4727-72ce-476a-a37a-1672bb4c42ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c58c54aeaa7496c8373ab61257d461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:09Z,use_quota=True,user_id='9d39599e9aa848d6b27f3181865f6f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Creating volume 21eb4727-72ce-476a-a37a-1672bb4c42ca {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6f6701-1e00-444b-acb5-d331a3eed0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfddbff-77ad-4a70-89e5-0a103ff18893', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:11 devstack sudo[99328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca 1073741824
Sep 16 22:01:11 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6c61f5-93e1-4e07-8460-43a071640b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Volume volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 (bbfddbff-77ad-4a70-89e5-0a103ff18893): created successfully
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6c61f5-93e1-4e07-8460-43a071640b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Flow 'volume_create_manager' (05f704d9-4306-4c9e-b573-e0f23a2e6780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a43b074e-482d-450f-bc48-eb86c422a7b4 tempest-VolumesNegativeTest-1461279222 None] Created volume successfully.
Sep 16 22:01:12 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Deleted volume successfully.
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d328e7d-dede-46d7-9b03-f83ad6a839d2 tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-4c81475e-676b-4a83-969d-8d9697c047e8-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-quobyte-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d842346-cca7-4cca-b52a-531ebca45468]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:12 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca 1073741824" returned: 0 in 0.637s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:12 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25
Sep 16 22:01:12 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca
Sep 16 22:01:12 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:12 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:12 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca" returned: 0 in 0.338s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb2d57c-65e5-445e-9951-e1749bc8f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21eb4727-72ce-476a-a37a-1672bb4c42ca', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17f68b0-b8c7-4dd0-befd-91514054d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Volume volume-21eb4727-72ce-476a-a37a-1672bb4c42ca (21eb4727-72ce-476a-a37a-1672bb4c42ca): created successfully
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17f68b0-b8c7-4dd0-befd-91514054d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:12 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Flow 'volume_create_manager' (77c27138-d0a3-4e7a-a07e-573ba78aea54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" returned: 0 in 0.503s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0791f1a0-e475-45e0-936a-be9f90d88717 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created volume successfully.
Sep 16 22:01:12 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25
Sep 16 22:01:12 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Flow 'volume_create_manager' (2f1fc0ec-4284-428e-adba-c18b1ce4948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d02c37-ab73-49c8-aed5-e4ebab46d53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d02c37-ab73-49c8-aed5-e4ebab46d53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-950765366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2def290-6a5b-43ed-b92e-7c4cdbebc564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ef844eb38945ff9cdde059adf5368a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:13Z,use_quota=True,user_id='5775eaff3bc14411bb65899102dab464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02953d87-2d2c-4775-837d-b26daf66f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02953d87-2d2c-4775-837d-b26daf66f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe27601-90e0-4b3b-b420-0684736729cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe27601-90e0-4b3b-b420-0684736729cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2def290-6a5b-43ed-b92e-7c4cdbebc564', 'volume_name': 'volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bb7af7-06cd-4cab-a7f4-6f71559494b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bb7af7-06cd-4cab-a7f4-6f71559494b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ce00f-8907-47d1-9a3a-2390eae60ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Volume d2def290-6a5b-43ed-b92e-7c4cdbebc564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564', 'volume_size': 1}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-950765366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2def290-6a5b-43ed-b92e-7c4cdbebc564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ef844eb38945ff9cdde059adf5368a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:13Z,use_quota=True,user_id='5775eaff3bc14411bb65899102dab464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Creating volume d2def290-6a5b-43ed-b92e-7c4cdbebc564 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:13 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:13 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 1073741824
Sep 16 22:01:13 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:13 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25" released by "delete_volume" :: held 0.881s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-21eb4727-72ce-476a-a37a-1672bb4c42ca-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Created reservations ['3c14e018-67d7-43ad-abcc-a0e9bf17da94', '67c04e6d-73a7-488e-b7bf-480bb955d7db', '23d31fab-3df0-4c63-a4cd-538cac3815dc', 'c1379691-aa76-429b-831f-1d021804f3ac'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-21eb4727-72ce-476a-a37a-1672bb4c42ca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-21eb4727-72ce-476a-a37a-1672bb4c42ca" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-21eb4727-72ce-476a-a37a-1672bb4c42ca" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[15121f94-a7d7-4d8e-9c08-f2f06d25d9e0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:13 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:13 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:13 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca
Sep 16 22:01:13 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:13 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 1073741824" returned: 0 in 0.619s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:13 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564
Sep 16 22:01:13 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:13 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.335s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Deleted volume successfully.
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d4f06cc-d90d-43ba-a932-7603a4d4510f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-daed6e3e-417f-4e5e-9a8d-b7d04d7a4b25-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:13 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca" returned: 0 in 0.485s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:14 devstack sudo[99367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca
Sep 16 22:01:14 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:14 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564" returned: 0 in 0.320s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ce00f-8907-47d1-9a3a-2390eae60ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7b01ee-162b-405f-add1-1aff68bc6039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Volume volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 (d2def290-6a5b-43ed-b92e-7c4cdbebc564): created successfully
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7b01ee-162b-405f-add1-1aff68bc6039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Flow 'volume_create_manager' (2f1fc0ec-4284-428e-adba-c18b1ce4948a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6220a59b-0865-4ef1-ad9f-8a48e9f34eb8 tempest-VolumesServicesTestJSON-855080627 None] Created volume successfully.
Sep 16 22:01:14 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-21eb4727-72ce-476a-a37a-1672bb4c42ca" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-21eb4727-72ce-476a-a37a-1672bb4c42ca" released by "delete_volume" :: held 0.840s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['b50c7afb-a8b6-4d9b-a983-610aa2985ba3', '1282cd79-3c39-49b0-8693-3b8acb5ac301', 'b6d6da81-f87b-4aba-ab99-664ed772a068', '4d44a5b2-4f49-4b87-8263-65aac0acd07d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:14 devstack sudo[99371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:14 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-d54fc294-6110-4db2-9912-3e592c4f1084-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-d54fc294-6110-4db2-9912-3e592c4f1084-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-d54fc294-6110-4db2-9912-3e592c4f1084" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-d54fc294-6110-4db2-9912-3e592c4f1084" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b034ace-1508-4b51-8321-6c2be1e17427]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:14 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.337s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97c250c3-d203-47e2-bcfe-bd48a29c8639 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-21eb4727-72ce-476a-a37a-1672bb4c42ca-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-9f25d087-ee60-49c3-b6a6-9b603cab308c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-9f25d087-ee60-49c3-b6a6-9b603cab308c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:14 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084
Sep 16 22:01:15 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "cinder-quobyte-9f25d087-ee60-49c3-b6a6-9b603cab308c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-9f25d087-ee60-49c3-b6a6-9b603cab308c" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed7f2bb-94ca-450b-bad6-36e103972402]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:15 devstack sudo[99376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c
Sep 16 22:01:15 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Acquiring lock "cinder-d2def290-6a5b-43ed-b92e-7c4cdbebc564-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "cinder-d2def290-6a5b-43ed-b92e-7c4cdbebc564-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:15 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Acquiring lock "cinder-quobyte-d2def290-6a5b-43ed-b92e-7c4cdbebc564" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084" returned: 0 in 0.670s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "cinder-quobyte-d2def290-6a5b-43ed-b92e-7c4cdbebc564" acquired by "delete_volume" :: waited 0.042s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:15 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084
Sep 16 22:01:15 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9652725-2a32-46dd-8462-5b9971bee211]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:15 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564
Sep 16 22:01:15 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:15 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c" returned: 0 in 0.788s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:15 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d54fc294-6110-4db2-9912-3e592c4f1084" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:15 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c
Sep 16 22:01:15 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-d54fc294-6110-4db2-9912-3e592c4f1084" released by "delete_volume" :: held 1.156s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['55b91168-e7d0-40fe-96e4-a1c277af13db', 'a64f19c9-06cb-4343-a962-4bb122eca29b', 'f868d9e9-a7a9-4901-8d26-68d3fb576bde', '92c1c634-5eed-4916-b542-f22a650ca2a1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:16 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564" returned: 0 in 0.578s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:16 devstack sudo[99409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:16 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:16 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564
Sep 16 22:01:16 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:16 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9f25d087-ee60-49c3-b6a6-9b603cab308c" returned: 0 in 0.372s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-quobyte-9f25d087-ee60-49c3-b6a6-9b603cab308c" released by "delete_volume" :: held 1.228s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Created reservations ['51407e76-7893-4ba8-be7d-ea15073cd709', 'b7abbac7-23d9-43e8-90cd-82a92ff378d4', 'f9956783-03e5-4de3-8f58-9faab1e5a7dc', 'cbce388a-be71-498b-8585-bc8e2dad8a47'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:16 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:16 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:16 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d2def290-6a5b-43ed-b92e-7c4cdbebc564" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:16 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "cinder-quobyte-d2def290-6a5b-43ed-b92e-7c4cdbebc564" released by "delete_volume" :: held 1.073s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d55e5471-d64f-4003-b8e5-3c178c89387d tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-d54fc294-6110-4db2-9912-3e592c4f1084-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Created reservations ['9488ef83-f3eb-4956-addb-b718a4ba8b06', '86ecd5c9-00ed-4f4e-92ac-1578129673db', '639cbbbe-00c5-464b-8c45-54f79c2d77af', '54c689d4-b483-49ec-8fe1-5fb839ccc561'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:16 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.341s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Deleted volume successfully.
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-521ea29c-d00a-4195-aeab-f1441828574f tempest-AttachVolumeNegativeTest-384733218 None] Lock "cinder-9f25d087-ee60-49c3-b6a6-9b603cab308c-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:16 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:16 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-158ab19c-410e-488c-95a6-40e2f4e6ef2b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-158ab19c-410e-488c-95a6-40e2f4e6ef2b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-158ab19c-410e-488c-95a6-40e2f4e6ef2b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-158ab19c-410e-488c-95a6-40e2f4e6ef2b" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9259e4-3580-455e-8629-a4f05619d144]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:17 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:17 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b
Sep 16 22:01:17 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:17 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Deleted volume successfully.
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-66df38db-7238-4a22-b363-afec0e05b999 tempest-VolumesServicesTestJSON-855080627 None] Lock "cinder-d2def290-6a5b-43ed-b92e-7c4cdbebc564-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:17 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:17 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b
Sep 16 22:01:17 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:17 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-158ab19c-410e-488c-95a6-40e2f4e6ef2b" returned: 0 in 0.273s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-158ab19c-410e-488c-95a6-40e2f4e6ef2b" released by "delete_volume" :: held 0.735s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['ca6bc7e8-e7c9-42fa-8bbe-ba78bdf562d9', '06166082-780d-4d4f-b687-239db1b45c47', 'b4f7869b-fbc2-4b83-9461-a55160f18961', '166528d0-edfa-42a4-8a51-0de38c686b6c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:17 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:17 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-b9e78fd1-34c8-424e-96b8-2cb9b760455d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:18 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-b9e78fd1-34c8-424e-96b8-2cb9b760455d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4d969c7-c72e-42b9-b2ff-61ede66e4848 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-158ab19c-410e-488c-95a6-40e2f4e6ef2b-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-b9e78fd1-34c8-424e-96b8-2cb9b760455d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-b9e78fd1-34c8-424e-96b8-2cb9b760455d" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76fa9eb-e813-487c-b311-bede197d2e76]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:18 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d
Sep 16 22:01:18 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:18 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d" returned: 0 in 0.448s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:18 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d
Sep 16 22:01:18 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:19 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b9e78fd1-34c8-424e-96b8-2cb9b760455d" returned: 0 in 0.486s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-b9e78fd1-34c8-424e-96b8-2cb9b760455d" released by "delete_volume" :: held 1.046s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['61c364b1-99a6-4b6c-9e1b-44e6b857a8c8', '70c21ada-585a-477c-b751-ad32624f0092', '043dc56d-2c82-43e5-9757-ad13c8acb20a', 'd5a75128-4751-40ab-8e82-50a891b24aa6'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:19 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:19 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:20 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.469s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bdbd6ffc-933c-41e1-9f09-e4e4643414a2 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-b9e78fd1-34c8-424e-96b8-2cb9b760455d-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-228cc4f5-326e-4599-905f-8b0593d36f02-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-228cc4f5-326e-4599-905f-8b0593d36f02-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-228cc4f5-326e-4599-905f-8b0593d36f02" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-228cc4f5-326e-4599-905f-8b0593d36f02" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d323e36-e393-44c6-9cef-91543eeb7d52]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:21 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02
Sep 16 22:01:21 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:21 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02" returned: 0 in 0.649s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:21 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02
Sep 16 22:01:21 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:22 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:22 devstack sudo[99532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-228cc4f5-326e-4599-905f-8b0593d36f02" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:22 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-228cc4f5-326e-4599-905f-8b0593d36f02" released by "delete_volume" :: held 1.158s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['f5439021-b915-4990-8b79-483d4d263dd9', 'df2acb97-1da5-48f0-a8b7-756958817e11', 'eeaaeb1c-d49c-445f-a05d-fae1d3905244', '42a1cc3e-47b6-4bbd-b12d-470a40746712'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:22 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:22 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:22 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.473s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:01:22 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-33cd995e-9ddd-4488-bdbe-1b4a112cbac5 tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-228cc4f5-326e-4599-905f-8b0593d36f02-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-c4bfdea6-747b-4bd8-a68a-c4916dd434f3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-c4bfdea6-747b-4bd8-a68a-c4916dd434f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "cinder-quobyte-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" acquired by "delete_volume" :: waited 0.074s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0641748b-be7d-4891-9543-342bdeb756ea]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:23 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3
Sep 16 22:01:23 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:24 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" returned: 0 in 0.743s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:24 devstack sudo[99545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3
Sep 16 22:01:24 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:24 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" returned: 0 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-quobyte-c4bfdea6-747b-4bd8-a68a-c4916dd434f3" released by "delete_volume" :: held 1.241s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Created reservations ['fbab1f5c-e740-435e-9732-50f15df3f556', 'fc09dbf5-af92-4d5f-bca2-a2fa163713ab', 'ad5f819c-b7db-4222-abd6-0ca38e2fce51', '75d2b143-3470-4c99-855c-51abf0a274ca'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:24 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:24 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:25 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.315s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:25 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Deleted volume successfully.
Sep 16 22:01:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e63163e3-81d6-46c9-a2b2-282a6a14905b tempest-CreateVolumesFromSourceVolumeTest-2090415894 None] Lock "cinder-c4bfdea6-747b-4bd8-a68a-c4916dd434f3-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Flow 'volume_create_manager' (56c8e049-8289-46ba-aff0-4ed73ded1bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7b5c6f-e544-4f27-9f61-f705c40778eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7b5c6f-e544-4f27-9f61-f705c40778eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1221750588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a87eaf-4e23-4c1d-b662-ece0c4851fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3568d534295447d689c46345875fbdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:29Z,use_quota=True,user_id='ffb376ba023d4f25b70fb063c1361adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5b385-e12e-47af-bbcf-327c5b6b9362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5b385-e12e-47af-bbcf-327c5b6b9362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973d84e-d65f-4d12-8965-d4e7ee71f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f973d84e-d65f-4d12-8965-d4e7ee71f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a87eaf-4e23-4c1d-b662-ece0c4851fec', 'volume_name': 'volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f716cef1-5f54-41b6-8f3c-e05bda803762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f716cef1-5f54-41b6-8f3c-e05bda803762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eaa399-8517-4678-97c3-3ca55ffa81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:29 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Volume a9a87eaf-4e23-4c1d-b662-ece0c4851fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec', 'volume_size': 1}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1221750588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a87eaf-4e23-4c1d-b662-ece0c4851fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3568d534295447d689c46345875fbdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:29Z,use_quota=True,user_id='ffb376ba023d4f25b70fb063c1361adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Creating volume a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:29 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:29 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec 1073741824
Sep 16 22:01:29 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:30 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec 1073741824" returned: 0 in 0.492s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:30 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec
Sep 16 22:01:30 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:30 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eaa399-8517-4678-97c3-3ca55ffa81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e456cc-970c-4a1f-bdd4-15447dc6f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:30 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Volume volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec (a9a87eaf-4e23-4c1d-b662-ece0c4851fec): created successfully
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e456cc-970c-4a1f-bdd4-15447dc6f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Flow 'volume_create_manager' (56c8e049-8289-46ba-aff0-4ed73ded1bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:30 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b61e8abe-09bb-4785-9ac6-d701c8ace126 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Created volume successfully.
Sep 16 22:01:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Creating offline snapshot 94ab9871-75ea-4e3d-8856-3967d454d50a of volume a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:01:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8c378-6e29-4ef2-a5bf-adb028b3b92e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:31 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec
Sep 16 22:01:31 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:32 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" returned: 0 in 0.417s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:32 devstack sudo[99592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a 1G
Sep 16 22:01:32 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:32 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a 1G" returned: 0 in 0.486s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:32 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a
Sep 16 22:01:32 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:33 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:33 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a is being set with open permissions: ugo+rw
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:33 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a
Sep 16 22:01:33 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:33 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a" returned: 0 in 0.270s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:33 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info
Sep 16 22:01:33 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:33 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:33 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info is being set with open permissions: ugo+rw
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:33 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info
Sep 16 22:01:33 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:33 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.info" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d7c8fe43-bf5e-4917-a817-b049edc71bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Create snapshot completed successfully
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "cinder-94ab9871-75ea-4e3d-8856-3967d454d50a-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-94ab9871-75ea-4e3d-8856-3967d454d50a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "cinder-quobyte-94ab9871-75ea-4e3d-8856-3967d454d50a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-94ab9871-75ea-4e3d-8856-3967d454d50a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Deleting offline snapshot 94ab9871-75ea-4e3d-8856-3967d454d50a of volume a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] snapshot_file for this snap is: volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e94010c-3336-4acb-9734-f5e9146b963a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:34 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a
Sep 16 22:01:34 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:35 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a" returned: 0 in 0.399s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d48bd6-3234-4578-b326-a75ec1b363f4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:35 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec
Sep 16 22:01:35 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Acquiring lock "cinder-bbfddbff-77ad-4a70-89e5-0a103ff18893-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "cinder-bbfddbff-77ad-4a70-89e5-0a103ff18893-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:35 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:35 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a
Sep 16 22:01:35 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Acquiring lock "cinder-quobyte-bbfddbff-77ad-4a70-89e5-0a103ff18893" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "cinder-quobyte-bbfddbff-77ad-4a70-89e5-0a103ff18893" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86c7c5a-589a-4cfc-bf3e-54c0f5bbc30c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:35 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893
Sep 16 22:01:35 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:36 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a" returned: 0 in 0.400s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:36 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a
Sep 16 22:01:36 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:36 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893" returned: 0 in 0.414s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:36 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893
Sep 16 22:01:36 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:36 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec.94ab9871-75ea-4e3d-8856-3967d454d50a" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-94ab9871-75ea-4e3d-8856-3967d454d50a" released by "_delete_snapshot" :: held 1.633s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" released by "delete_snapshot" :: held 1.672s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:36 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bbfddbff-77ad-4a70-89e5-0a103ff18893" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Created reservations ['e09ea6b6-87cf-42a2-bcdb-7acf4fbd9769', '20e30656-09a9-48ed-a72c-cad8085ed71e', '08dd3b89-09c6-47d3-aa9b-b7d8b5bf2e7f', 'd10a6293-56de-4934-bdf0-0fff2c3a1ee6'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "cinder-quobyte-bbfddbff-77ad-4a70-89e5-0a103ff18893" released by "delete_volume" :: held 0.776s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Delete snapshot completed successfully.
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2b2ff453-fb55-44cc-9440-10c5f154c502 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-94ab9871-75ea-4e3d-8856-3967d454d50a-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Created reservations ['790be7fc-817d-4f2a-8e4f-ccaea3599113', '77e1aa63-9dd5-4560-9098-9553d843af6e', 'f23d28e2-503a-43d8-aa51-78c385863f57', '895d1855-2277-4fc5-b3b7-1734829360bf'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:36 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:36 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:36 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Deleted volume successfully.
Sep 16 22:01:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c69be325-ea23-416c-924c-9d1ea7fbe33e tempest-VolumesNegativeTest-1461279222 None] Lock "cinder-bbfddbff-77ad-4a70-89e5-0a103ff18893-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "cinder-a9a87eaf-4e23-4c1d-b662-ece0c4851fec-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-a9a87eaf-4e23-4c1d-b662-ece0c4851fec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[017261f5-76a4-45e2-98d6-a235f7489ffa]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:37 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec
Sep 16 22:01:37 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:37 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:37 devstack sudo[99649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec
Sep 16 22:01:37 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:37 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" returned: 0 in 0.267s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-quobyte-a9a87eaf-4e23-4c1d-b662-ece0c4851fec" released by "delete_volume" :: held 0.720s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Created reservations ['7a4e3755-0589-4098-ac67-1075c8415404', 'c432484b-2bef-4060-a7ac-a46478d4d706', 'd0cd3227-3c70-47be-961d-cc5b05ce9784', '4eadf6d3-f76b-453c-8c80-5ec890ad510e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:37 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:37 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:38 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:38 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Deleted volume successfully.
Sep 16 22:01:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-59ed2c12-4c65-447f-b981-f4efc8fe80e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027849662 None] Lock "cinder-a9a87eaf-4e23-4c1d-b662-ece0c4851fec-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:INSERT=40,cinder:SELECT=122,cinder:UPDATE=168,cinder:DELETE=14 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=120,cinder:UPDATE=180,cinder:INSERT=43,cinder:DELETE=15 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Flow 'volume_create_manager' (50e2cb6e-c976-47e2-b752-541c3490b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc28ebd-fb46-4366-8311-a83a328bd040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc28ebd-fb46-4366-8311-a83a328bd040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-941818497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e991675-951a-43ca-9f46-5a558b60d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e8d00ab0de4784b1e663363ebba0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:47Z,use_quota=True,user_id='7fd78072c1ca42d1b20547e778089874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb31081-c4e0-41ad-8026-e93c42826141),volume_type_id=9fb31081-c4e0-41ad-8026-e93c42826141)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db64ad5e-a03e-49fb-8a93-df39847a33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db64ad5e-a03e-49fb-8a93-df39847a33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e1ce6e-1c29-4902-bcee-cf768095feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e1ce6e-1c29-4902-bcee-cf768095feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e991675-951a-43ca-9f46-5a558b60d37a', 'volume_name': 'volume-5e991675-951a-43ca-9f46-5a558b60d37a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7427e213-ae37-4982-93b1-cbb6077d5332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7427e213-ae37-4982-93b1-cbb6077d5332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3777b5e-2919-41e6-8ad9-751e5d98b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:46 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Volume 5e991675-951a-43ca-9f46-5a558b60d37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e991675-951a-43ca-9f46-5a558b60d37a', 'volume_size': 1}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-941818497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e991675-951a-43ca-9f46-5a558b60d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e8d00ab0de4784b1e663363ebba0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:01:47Z,use_quota=True,user_id='7fd78072c1ca42d1b20547e778089874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb31081-c4e0-41ad-8026-e93c42826141),volume_type_id=9fb31081-c4e0-41ad-8026-e93c42826141)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Creating volume 5e991675-951a-43ca-9f46-5a558b60d37a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:01:47 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:47 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a 1073741824
Sep 16 22:01:47 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:47 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a 1073741824" returned: 0 in 0.630s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:47 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a
Sep 16 22:01:47 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:48 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a" returned: 0 in 0.318s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3777b5e-2919-41e6-8ad9-751e5d98b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e991675-951a-43ca-9f46-5a558b60d37a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705d9e92-3abd-44f6-bb50-81c5be3feb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:01:48 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Volume volume-5e991675-951a-43ca-9f46-5a558b60d37a (5e991675-951a-43ca-9f46-5a558b60d37a): created successfully
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705d9e92-3abd-44f6-bb50-81c5be3feb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:01:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Flow 'volume_create_manager' (50e2cb6e-c976-47e2-b752-541c3490b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:01:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0eb1b595-f0a5-4258-83ab-aaf5749fa275 tempest-VolumeTypesAccessTest-1595645102 None] Created volume successfully.
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Acquiring lock "cinder-5e991675-951a-43ca-9f46-5a558b60d37a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "cinder-5e991675-951a-43ca-9f46-5a558b60d37a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Acquiring lock "cinder-quobyte-5e991675-951a-43ca-9f46-5a558b60d37a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "cinder-quobyte-5e991675-951a-43ca-9f46-5a558b60d37a" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bd5f77-6846-4e36-b60e-25d9b90407b2]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:49 devstack sudo[99708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a
Sep 16 22:01:49 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:49 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a" returned: 0 in 0.518s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:49 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a
Sep 16 22:01:49 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:50 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e991675-951a-43ca-9f46-5a558b60d37a" returned: 0 in 0.331s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "cinder-quobyte-5e991675-951a-43ca-9f46-5a558b60d37a" released by "delete_volume" :: held 0.909s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:01:50 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-155208311 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-155208311, it is now deprecated. Please use the default quota class for default quota.
Sep 16 22:01:50 devstack cinder-volume[85936]: WARNING cinder.quota [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-155208311 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-155208311, it is now deprecated. Please use the default quota class for default quota.
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Created reservations ['50c1f326-9869-4ebd-93ef-2de428ea1fdc', 'c28bd7dd-cf37-4d40-abb8-7f790de7e2ab', 'fc1f75e8-0b55-4677-ae7a-21f4306c4e14', '166ac826-973c-435f-82af-282a6f233238'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:01:50 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:01:50 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:01:50 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.296s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:01:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Deleted volume successfully.
Sep 16 22:01:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c484a9d-9338-48e1-838d-a01589dec558 tempest-VolumeTypesAccessTest-1595645102 None] Lock "cinder-5e991675-951a-43ca-9f46-5a558b60d37a-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:00 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:02:00 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Flow 'volume_create_manager' (6d055b40-3563-493d-b93e-ce6deef112c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0bddd0-33b6-4d07-9f0f-b950e0e049cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0bddd0-33b6-4d07-9f0f-b950e0e049cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-978021456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699cee37-ed8c-4bc7-a4b6-76bcb66e07cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd3ce4cf9124361a4b07bb2469e8651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:02Z,use_quota=True,user_id='9264e99404874aeea816852b2fcf7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac0ee3d-be37-4d5f-9be8-fa2a52559d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac0ee3d-be37-4d5f-9be8-fa2a52559d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18082d05-78c0-4499-a46f-57960c0c6405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18082d05-78c0-4499-a46f-57960c0c6405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699cee37-ed8c-4bc7-a4b6-76bcb66e07cb', 'volume_name': 'volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e15c7b-b513-4ab1-815a-e06aede0ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e15c7b-b513-4ab1-815a-e06aede0ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903f65a7-1cdb-4bf0-a71f-ce11f62adff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume 699cee37-ed8c-4bc7-a4b6-76bcb66e07cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb', 'volume_size': 1}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-978021456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699cee37-ed8c-4bc7-a4b6-76bcb66e07cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd3ce4cf9124361a4b07bb2469e8651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:02Z,use_quota=True,user_id='9264e99404874aeea816852b2fcf7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Creating volume 699cee37-ed8c-4bc7-a4b6-76bcb66e07cb {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:01 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:02 devstack sudo[99720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb 1073741824
Sep 16 22:02:02 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Flow 'volume_create_manager' (fefad798-4d18-43e6-b55d-76d2d5479a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882d80ef-5819-41fd-9f4b-1e172c40acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882d80ef-5819-41fd-9f4b-1e172c40acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-991808495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd3ce4cf9124361a4b07bb2469e8651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:02Z,use_quota=True,user_id='9264e99404874aeea816852b2fcf7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ee3e67-7ee9-4ff2-859e-142722ae48cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ee3e67-7ee9-4ff2-859e-142722ae48cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f28fb6-b04c-4964-b1df-7fa8dd4c32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f28fb6-b04c-4964-b1df-7fa8dd4c32fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be', 'volume_name': 'volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe725694-309a-41da-9cd3-ba7711d50ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe725694-309a-41da-9cd3-ba7711d50ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560864c1-858b-4779-a30e-347de1d5fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:02 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be', 'volume_size': 1}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:02 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb 1073741824" returned: 0 in 0.678s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:02 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb
Sep 16 22:02:02 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:03 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" returned: 0 in 0.320s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-991808495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd3ce4cf9124361a4b07bb2469e8651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:02Z,use_quota=True,user_id='9264e99404874aeea816852b2fcf7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Creating volume ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903f65a7-1cdb-4bf0-a71f-ce11f62adff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f67708-1358-4cb0-8289-f9f68bd55502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:03 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be 1073741824
Sep 16 22:02:03 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb (699cee37-ed8c-4bc7-a4b6-76bcb66e07cb): created successfully
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f67708-1358-4cb0-8289-f9f68bd55502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Flow 'volume_create_manager' (6d055b40-3563-493d-b93e-ce6deef112c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8e6ec2d3-78c9-463d-8c1c-1de459aee89d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Created volume successfully.
Sep 16 22:02:03 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be 1073741824" returned: 0 in 0.589s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:03 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be
Sep 16 22:02:03 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:03 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" returned: 0 in 0.279s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560864c1-858b-4779-a30e-347de1d5fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a698218-0dd4-4b2b-9ccf-ddc8ddfc5f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Volume volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be (ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be): created successfully
Sep 16 22:02:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a698218-0dd4-4b2b-9ccf-ddc8ddfc5f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Flow 'volume_create_manager' (fefad798-4d18-43e6-b55d-76d2d5479a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ab01a209-611d-46b0-9e63-c43a7969e71d tempest-TestServerVolumeAttachmentScenario-1977358795 None] Created volume successfully.
Sep 16 22:02:13 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:02:14 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=1,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (46d1e465-40db-4043-a194-44f56da9d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d2ae5a-49d4-4dec-8b62-ecffcd8ce8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d2ae5a-49d4-4dec-8b62-ecffcd8ce8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446984665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dc1df1-4b9d-4b58-ad79-04e050bb4672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:20Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa79fe8c-e73a-49be-8a06-38c8cb5567d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa79fe8c-e73a-49be-8a06-38c8cb5567d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea42d822-25f5-4816-86b0-90a0933fb016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea42d822-25f5-4816-86b0-90a0933fb016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2dc1df1-4b9d-4b58-ad79-04e050bb4672', 'volume_name': 'volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555669fd-eee3-492e-a287-236c4ad77c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555669fd-eee3-492e-a287-236c4ad77c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714c6ea6-8405-433d-a1f3-2d46a6efc0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:20 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Volume b2dc1df1-4b9d-4b58-ad79-04e050bb4672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672', 'volume_size': 1}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1446984665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2dc1df1-4b9d-4b58-ad79-04e050bb4672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:20Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Creating volume b2dc1df1-4b9d-4b58-ad79-04e050bb4672 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:20 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:20 devstack sudo[99835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 1073741824
Sep 16 22:02:20 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:21 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 1073741824" returned: 0 in 0.490s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:21 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672
Sep 16 22:02:21 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:21 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714c6ea6-8405-433d-a1f3-2d46a6efc0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9532c8-e710-49d9-850c-cc544d11a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Volume volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 (b2dc1df1-4b9d-4b58-ad79-04e050bb4672): created successfully
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9532c8-e710-49d9-850c-cc544d11a043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (46d1e465-40db-4043-a194-44f56da9d86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-97fa5659-7576-48a7-acf4-68a499add2d2 tempest-VolumesListAdminTestJSON-1561259992 None] Created volume successfully.
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:22 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:22 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:22 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:02:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (051f9a0d-f6b9-4f3f-b257-ba0a106faa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f49da0-81b4-4eb9-91aa-2c1704a79b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f49da0-81b4-4eb9-91aa-2c1704a79b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1779743534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c0e9fc-3489-4745-b0ce-288b687105d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:23Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa051f-2123-4db7-8fe5-9f7e3654ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa051f-2123-4db7-8fe5-9f7e3654ca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb0349d-5607-4a15-9fc2-314f2402ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb0349d-5607-4a15-9fc2-314f2402ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c0e9fc-3489-4745-b0ce-288b687105d0', 'volume_name': 'volume-64c0e9fc-3489-4745-b0ce-288b687105d0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27079ebd-3c09-44cb-a3d8-ae6276f99595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27079ebd-3c09-44cb-a3d8-ae6276f99595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09ddfb4-299a-45ef-a671-4996150b1643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:23 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Volume 64c0e9fc-3489-4745-b0ce-288b687105d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c0e9fc-3489-4745-b0ce-288b687105d0', 'volume_size': 1}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1779743534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c0e9fc-3489-4745-b0ce-288b687105d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:23Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Creating volume 64c0e9fc-3489-4745-b0ce-288b687105d0 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:23 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:23 devstack sudo[99848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 1073741824
Sep 16 22:02:23 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:24 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 1073741824" returned: 0 in 0.542s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:24 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0
Sep 16 22:02:24 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:24 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09ddfb4-299a-45ef-a671-4996150b1643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c0e9fc-3489-4745-b0ce-288b687105d0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93031370-e97d-4c3f-a614-a5e7ffcf09f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Volume volume-64c0e9fc-3489-4745-b0ce-288b687105d0 (64c0e9fc-3489-4745-b0ce-288b687105d0): created successfully
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93031370-e97d-4c3f-a614-a5e7ffcf09f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (051f9a0d-f6b9-4f3f-b257-ba0a106faa86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4f337ec4-1546-46c2-81a3-d7d82819756a tempest-VolumesListAdminTestJSON-1561259992 None] Created volume successfully.
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (53c54ef9-1622-4a39-8517-576c21771091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603e4957-4d8b-4fac-9574-9c911af10214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603e4957-4d8b-4fac-9574-9c911af10214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1584723014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c64e3cb-9edd-4214-aa34-e4b6ec1daddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:26Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81afb57c-3e04-40b9-aa9b-2800f05d0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81afb57c-3e04-40b9-aa9b-2800f05d0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b973d320-1ad7-45f9-bc60-3138fc65a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b973d320-1ad7-45f9-bc60-3138fc65a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c64e3cb-9edd-4214-aa34-e4b6ec1daddb', 'volume_name': 'volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49724e0d-d794-4a54-9888-5f5c9a731a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49724e0d-d794-4a54-9888-5f5c9a731a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9171b4e0-ed3a-447f-8575-288f6f44c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Volume 0c64e3cb-9edd-4214-aa34-e4b6ec1daddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb', 'volume_size': 1}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1584723014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c64e3cb-9edd-4214-aa34-e4b6ec1daddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0974726e967411ca1d13a4e1f39f37c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:26Z,use_quota=True,user_id='fa717379b4d04093b3213845a96fc3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Creating volume 0c64e3cb-9edd-4214-aa34-e4b6ec1daddb {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:26 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:26 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb 1073741824
Sep 16 22:02:26 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:27 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb 1073741824" returned: 0 in 0.816s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:27 devstack sudo[99871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb
Sep 16 22:02:27 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:27 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9171b4e0-ed3a-447f-8575-288f6f44c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b559ce-36c8-41b6-8069-25503f414cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:27 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Volume volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb (0c64e3cb-9edd-4214-aa34-e4b6ec1daddb): created successfully
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b559ce-36c8-41b6-8069-25503f414cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Flow 'volume_create_manager' (53c54ef9-1622-4a39-8517-576c21771091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-be1a3ff9-d59f-4c2e-a019-7302fa7b62b1 tempest-VolumesListAdminTestJSON-1561259992 None] Created volume successfully.
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Flow 'volume_create_manager' (5296649c-1c1e-4ebb-81d3-490a25ed0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66f9fed-6e4a-4804-a2d4-c113a9af7e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66f9fed-6e4a-4804-a2d4-c113a9af7e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b9b8ad80bb4fdd91ced86960269089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:29Z,use_quota=True,user_id='8a937eaad5064b86a18b888c0f9352b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ee4ba2-0d3c-48f7-92c5-59536d4a277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ee4ba2-0d3c-48f7-92c5-59536d4a277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62eb7dc-4b0b-4872-98e4-8da8255f1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62eb7dc-4b0b-4872-98e4-8da8255f1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7', 'volume_name': 'volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259d3039-f6b1-436a-92ad-a520b9e50319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259d3039-f6b1-436a-92ad-a520b9e50319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf33db81-51e9-462e-a34d-afa523f99d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:28 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Volume 288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7', 'volume_size': 1}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b9b8ad80bb4fdd91ced86960269089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:29Z,use_quota=True,user_id='8a937eaad5064b86a18b888c0f9352b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Creating volume 288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:28 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:28 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 1073741824
Sep 16 22:02:28 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:29 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 1073741824" returned: 0 in 0.468s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:29 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7
Sep 16 22:02:29 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:29 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf33db81-51e9-462e-a34d-afa523f99d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e2e98-b23e-4bff-bc37-128305001e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:29 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Volume volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 (288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7): created successfully
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e2e98-b23e-4bff-bc37-128305001e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Flow 'volume_create_manager' (5296649c-1c1e-4ebb-81d3-490a25ed0efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b5afb7aa-5965-4301-b051-bf4544576df8 tempest-VolumesListAdminTestJSON-184859528 None] Created volume successfully.
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Acquiring lock "cinder-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "cinder-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Acquiring lock "cinder-quobyte-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "cinder-quobyte-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1bc8c6-c7b9-4eb0-b243-315df12c4034]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-quobyte-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" acquired by "delete_volume" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e81652-d9a7-4bd3-bdf0-1fbffba71bb6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:30 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7
Sep 16 22:02:30 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:30 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb
Sep 16 22:02:30 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:30 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" returned: 0 in 0.535s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:30 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7
Sep 16 22:02:30 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:30 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" returned: 0 in 0.536s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:30 devstack sudo[99927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb
Sep 16 22:02:30 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:31 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "cinder-quobyte-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7" released by "delete_volume" :: held 0.986s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Created reservations ['4ee6ef39-4f07-4d3a-9885-841929e71ad1', 'a17805b1-e6d0-431b-9187-2218f20a1df8', '021c7e58-760c-4c7c-96ea-d011761b5b71', '0fcf7a64-77f5-4cd9-a6f3-369cef4e2c17'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:31 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" returned: 0 in 0.302s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb" released by "delete_volume" :: held 0.898s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Created reservations ['22ff35ea-a643-480d-b6f4-cf49be6d6fed', '759ac3aa-fbc8-4df1-9c89-fa644a222801', '765f36dc-4eb1-469e-8b02-78a67905c3b5', '21144918-ae09-482a-98c5-850621417c2c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:31 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:31 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:31 devstack sudo[99938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:31 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:31 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Deleted volume successfully.
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2420c1ed-de0f-46b0-8899-0a3201fe27f5 tempest-VolumesListAdminTestJSON-184859528 None] Lock "cinder-288e20b7-9ecb-4cfa-8fa2-90d2afb3a7e7-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:31 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Deleted volume successfully.
Sep 16 22:02:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-727acfac-98f5-4ff5-b3b5-ddcd015548cd tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-0c64e3cb-9edd-4214-aa34-e4b6ec1daddb-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-64c0e9fc-3489-4745-b0ce-288b687105d0-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-64c0e9fc-3489-4745-b0ce-288b687105d0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-quobyte-64c0e9fc-3489-4745-b0ce-288b687105d0" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-64c0e9fc-3489-4745-b0ce-288b687105d0" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46ffcd-245d-489b-a674-010fb6a37a23]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:32 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0
Sep 16 22:02:32 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:33 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0" returned: 0 in 0.650s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:33 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0
Sep 16 22:02:33 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64c0e9fc-3489-4745-b0ce-288b687105d0" returned: 0 in 0.517s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:33 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-64c0e9fc-3489-4745-b0ce-288b687105d0" released by "delete_volume" :: held 1.228s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Created reservations ['7e6963e9-9e24-498a-84ce-40b3f1c9a84b', '7ebab748-ead8-48fd-92c8-fd19b8d75ceb', '64ecdd22-e15b-412c-aa24-a6e7d4db6957', 'be3a4179-2651-4d67-b771-098a2698f248'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:34 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:34 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:34 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.299s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:34 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Deleted volume successfully.
Sep 16 22:02:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3850292-1a53-42d4-9985-5fb9f8e50f7d tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-64c0e9fc-3489-4745-b0ce-288b687105d0-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-b2dc1df1-4b9d-4b58-ad79-04e050bb4672-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-b2dc1df1-4b9d-4b58-ad79-04e050bb4672-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "cinder-quobyte-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf3861-a5b2-431a-bd4a-5eea62060e0a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:35 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672
Sep 16 22:02:35 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:35 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" returned: 0 in 0.507s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:35 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672
Sep 16 22:02:35 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:35 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" returned: 0 in 0.297s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-quobyte-b2dc1df1-4b9d-4b58-ad79-04e050bb4672" released by "delete_volume" :: held 0.860s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Created reservations ['33100c18-504d-4fa3-87b0-d075a47ce8ce', '31386104-c7e7-424b-8a0d-733466925ab4', '16c68cdd-eaf7-433c-aeb8-967f013130e3', '03f87bc3-d842-4438-9d0b-ded7a9d2add6'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:36 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:36 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (c7b18cbe-d96c-465a-9de7-0289aff5e896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87d1c08-5e4d-4876-95a9-8187e8b52037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87d1c08-5e4d-4876-95a9-8187e8b52037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2767441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:36Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e416ad3-6f6e-4a28-8801-b620c9ab8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e416ad3-6f6e-4a28-8801-b620c9ab8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0cdc25-c5d2-476a-a835-a5d28f259871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0cdc25-c5d2-476a-a835-a5d28f259871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa', 'volume_name': 'volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085ddfc5-ff9e-46cf-9322-d180bc2ab014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085ddfc5-ff9e-46cf-9322-d180bc2ab014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1fa8cd-1cdd-4ee3-b6d0-f9c2f55ca34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:36 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Volume fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa', 'volume_size': 1}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2767441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:36Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Creating volume fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:36 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:36 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.486s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:36 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa 1073741824
Sep 16 22:02:36 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Deleted volume successfully.
Sep 16 22:02:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0200f07c-7133-4227-89e3-a428a4d388fc tempest-VolumesListAdminTestJSON-1561259992 None] Lock "cinder-b2dc1df1-4b9d-4b58-ad79-04e050bb4672-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:37 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa 1073741824" returned: 0 in 0.596s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:37 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa
Sep 16 22:02:37 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:37 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" returned: 0 in 0.308s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1fa8cd-1cdd-4ee3-b6d0-f9c2f55ca34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8751fbd-60eb-41cb-b5d7-073da5887396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Volume volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa (fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa): created successfully
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8751fbd-60eb-41cb-b5d7-073da5887396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (c7b18cbe-d96c-465a-9de7-0289aff5e896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d20cc1b5-e943-4020-95c3-2e3c396dfbf5 tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:02:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d9eb64c2-6ff8-4bba-92b2-346baaf3a22a tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" by "attach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d9eb64c2-6ff8-4bba-92b2-346baaf3a22a tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" acquired by "attach_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d9eb64c2-6ff8-4bba-92b2-346baaf3a22a tempest-VolumesActionsTest-1800828164 None] Attaching volume fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa to instance df2435d9-c81b-47a0-93c8-9640a556726f at mountpoint /dev/vdb on host None.
Sep 16 22:02:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d9eb64c2-6ff8-4bba-92b2-346baaf3a22a tempest-VolumesActionsTest-1800828164 None] Attach volume completed successfully.
Sep 16 22:02:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d9eb64c2-6ff8-4bba-92b2-346baaf3a22a tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" released by "attach_volume" :: held 0.106s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Terminate volume connection completed successfully.
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" by "detach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Detaching volume fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa from instance df2435d9-c81b-47a0-93c8-9640a556726f.
Sep 16 22:02:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Detach volume completed successfully.
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56adb208-a703-47a1-8860-ba5695b88d61 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-39abb598-592d-4439-a3f1-8685112934fc tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" by "detach_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-39abb598-592d-4439-a3f1-8685112934fc tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-39abb598-592d-4439-a3f1-8685112934fc tempest-VolumesActionsTest-1800828164 None] Volume detach called, but volume not attached.
Sep 16 22:02:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-39abb598-592d-4439-a3f1-8685112934fc tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-quobyte-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "cinder-quobyte-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b22b6-4378-44c7-94f2-6d8dbb2c5878]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:40 devstack sudo[100049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa
Sep 16 22:02:40 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:40 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" returned: 0 in 0.465s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:40 devstack sudo[100055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa
Sep 16 22:02:40 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:41 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "cinder-quobyte-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa" released by "delete_volume" :: held 0.915s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Created reservations ['822f8cf3-72a1-403f-b859-27158e1837f5', '0e012b73-2b1a-4afc-b2fe-94dd06f3e59d', '6e49edd4-3c63-41a0-a110-36665ca97425', 'c33f5bf2-ff7e-4ff8-bdfc-704725789d6d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-dbb7bd61-4746-4503-b718-2d038a1126a7 req-ee37924b-d47e-45a3-b79c-fd399eb3bb50 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-dbb7bd61-4746-4503-b718-2d038a1126a7 req-ee37924b-d47e-45a3-b79c-fd399eb3bb50 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:41 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-dbb7bd61-4746-4503-b718-2d038a1126a7 req-ee37924b-d47e-45a3-b79c-fd399eb3bb50 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:41 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-dbb7bd61-4746-4503-b718-2d038a1126a7 req-ee37924b-d47e-45a3-b79c-fd399eb3bb50 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d19141a-0d19-4586-96a5-4dec47030fdd', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:02:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-dbb7bd61-4746-4503-b718-2d038a1126a7 req-ee37924b-d47e-45a3-b79c-fd399eb3bb50 tempest-TestServerVolumeAttachmentScenario-1977358795 None] attachment_update completed successfully.
Sep 16 22:02:41 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.458s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Deleted volume successfully.
Sep 16 22:02:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b2af0731-c780-45a2-b4d2-16296710157f tempest-VolumesActionsTest-1800828164 None] Lock "cinder-fb2e0e33-0a39-4cdc-b03d-8a62a3cd09aa-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (67dacd6e-dc93-4271-b9e5-ff01dd7a2856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70ef9b7-adee-4590-9ea8-a19f40fd3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70ef9b7-adee-4590-9ea8-a19f40fd3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833793133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:45Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf50280-67bd-4d65-a818-82acfeeaab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf50280-67bd-4d65-a818-82acfeeaab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ffb9e-3a3a-4a7a-b593-de20c8a1c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14ffb9e-3a3a-4a7a-b593-de20c8a1c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a', 'volume_name': 'volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed11b7c-c63c-4b77-9feb-6f6906e5eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed11b7c-c63c-4b77-9feb-6f6906e5eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e58d4-ecca-47b1-8a49-bffc4e8fd8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Volume 0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a', 'volume_size': 1}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833793133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:45Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Creating volume 0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:45 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:45 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a 1073741824
Sep 16 22:02:45 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:46 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a 1073741824" returned: 0 in 0.487s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:46 devstack sudo[100547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a
Sep 16 22:02:46 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:46 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4e58d4-ecca-47b1-8a49-bffc4e8fd8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34622f2-99db-4d73-830d-18f0f916be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:46 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Volume volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a (0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a): created successfully
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34622f2-99db-4d73-830d-18f0f916be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (67dacd6e-dc93-4271-b9e5-ff01dd7a2856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:46 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5ac62840-f23a-4410-9017-c7ba6f3e20a4 tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8cb67461-5241-4d9d-94d3-a29266c42a6e req-c7077023-7c73-4ae4-a310-e98f7d3d9322 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8cb67461-5241-4d9d-94d3-a29266c42a6e req-c7077023-7c73-4ae4-a310-e98f7d3d9322 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-8cb67461-5241-4d9d-94d3-a29266c42a6e req-c7077023-7c73-4ae4-a310-e98f7d3d9322 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-8cb67461-5241-4d9d-94d3-a29266c42a6e req-c7077023-7c73-4ae4-a310-e98f7d3d9322 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '353d810c-815e-484e-abc3-7fd6e341c827', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-quobyte-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-8cb67461-5241-4d9d-94d3-a29266c42a6e req-c7077023-7c73-4ae4-a310-e98f7d3d9322 tempest-TestServerVolumeAttachmentScenario-1977358795 None] attachment_update completed successfully.
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce9481-cead-41a7-ac4d-5a5f76793cba]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:47 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a
Sep 16 22:02:47 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:48 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" returned: 0 in 0.465s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:48 devstack sudo[100576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a
Sep 16 22:02:48 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:48 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a" released by "delete_volume" :: held 0.830s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Created reservations ['742289c1-106e-48ed-ac4a-a45b14dc5bd4', '3637709c-1331-4112-b051-0abe45e8ba3b', '2f97d726-a767-4c71-8ed5-54f9d00248ed', 'cf20d272-c9d2-4543-a26f-61428baba397'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:48 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:48 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:49 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Deleted volume successfully.
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5a80e479-b779-4064-9b7b-cccac2887048 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-0d5bedc5-d36d-4e2b-936b-21d93f7f8f4a-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-3376b953-3f96-44c6-a0e1-59b42da003dc req-cb688df1-79ee-4394-af3e-cb5175af8ab0 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Terminate volume connection completed successfully.
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-3376b953-3f96-44c6-a0e1-59b42da003dc req-cb688df1-79ee-4394-af3e-cb5175af8ab0 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Deleting attachment 353d810c-815e-484e-abc3-7fd6e341c827. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (1c8ee6ce-d26f-4cf6-a08d-8739d64c3ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f17d3ec-dd1e-45f7-b7aa-0b4f9d3ee6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f17d3ec-dd1e-45f7-b7aa-0b4f9d3ee6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-281196701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e8ed02-59a8-485f-b262-21db5827d2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:50Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d88e27-c31f-4fc5-9f7b-ba7dbb8e64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d88e27-c31f-4fc5-9f7b-ba7dbb8e64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2e7ef9-b3d9-435c-85ee-0ae23bd12152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2e7ef9-b3d9-435c-85ee-0ae23bd12152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e8ed02-59a8-485f-b262-21db5827d2b0', 'volume_name': 'volume-14e8ed02-59a8-485f-b262-21db5827d2b0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db62950b-c58d-4a2c-bbc2-b5298724b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db62950b-c58d-4a2c-bbc2-b5298724b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9216b3-29ae-41b4-90a1-e5c071666cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Volume 14e8ed02-59a8-485f-b262-21db5827d2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e8ed02-59a8-485f-b262-21db5827d2b0', 'volume_size': 1}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-281196701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e8ed02-59a8-485f-b262-21db5827d2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:50Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Creating volume 14e8ed02-59a8-485f-b262-21db5827d2b0 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:49 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:49 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 1073741824
Sep 16 22:02:49 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:50 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 1073741824" returned: 0 in 0.459s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:50 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0
Sep 16 22:02:50 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:50 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0" returned: 0 in 0.284s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9216b3-29ae-41b4-90a1-e5c071666cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e8ed02-59a8-485f-b262-21db5827d2b0', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa1a432-6876-41f1-9900-7314632335fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Volume volume-14e8ed02-59a8-485f-b262-21db5827d2b0 (14e8ed02-59a8-485f-b262-21db5827d2b0): created successfully
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa1a432-6876-41f1-9900-7314632335fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (1c8ee6ce-d26f-4cf6-a08d-8739d64c3ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f614a2d6-d002-446d-a1f0-db6a0ce2fbbc tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Flow 'volume_create_manager' (56d113ae-3312-4f55-b448-f42df2c394e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09cd3e1-551e-4eae-b8d3-fa7d13e63c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09cd3e1-551e-4eae-b8d3-fa7d13e63c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-861656782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99abe1f2-857f-47f8-8a7c-e923d01ea08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f54446cefb4b5c9119aba97fe1c409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:51Z,use_quota=True,user_id='87651f658ba74116adeb2c44d6a6f98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dab04f7-591f-4ea6-b2cd-30af9ab2ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dab04f7-591f-4ea6-b2cd-30af9ab2ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19bff45-6da8-445a-941a-0a0244f29042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19bff45-6da8-445a-941a-0a0244f29042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99abe1f2-857f-47f8-8a7c-e923d01ea08f', 'volume_name': 'volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb76de72-21f7-4e31-8141-5b249afa74c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb76de72-21f7-4e31-8141-5b249afa74c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fd2f46-0871-4857-82bc-82ad5803b9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Volume 99abe1f2-857f-47f8-8a7c-e923d01ea08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f', 'volume_size': 1}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-861656782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99abe1f2-857f-47f8-8a7c-e923d01ea08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f54446cefb4b5c9119aba97fe1c409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:51Z,use_quota=True,user_id='87651f658ba74116adeb2c44d6a6f98a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Creating volume 99abe1f2-857f-47f8-8a7c-e923d01ea08f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:50 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:50 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f 1073741824
Sep 16 22:02:50 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-a8ede17d-356e-4fac-bd8b-e1ce3e8c2f08 req-6d803b15-2469-4447-948e-dc80ffd38989 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Terminate volume connection completed successfully.
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-a8ede17d-356e-4fac-bd8b-e1ce3e8c2f08 req-6d803b15-2469-4447-948e-dc80ffd38989 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Deleting attachment 8d19141a-0d19-4586-96a5-4dec47030fdd. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:02:51 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f 1073741824" returned: 0 in 0.478s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:51 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f
Sep 16 22:02:51 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:51 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fd2f46-0871-4857-82bc-82ad5803b9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e5f10-3029-4db7-9bbb-bdd7b778fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Volume volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f (99abe1f2-857f-47f8-8a7c-e923d01ea08f): created successfully
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e5f10-3029-4db7-9bbb-bdd7b778fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Flow 'volume_create_manager' (56d113ae-3312-4f55-b448-f42df2c394e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7a87960f-b325-4253-a5d5-aecc86a040fc tempest-VolumesMetadataTest-1977555754 None] Created volume successfully.
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-14e8ed02-59a8-485f-b262-21db5827d2b0-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-14e8ed02-59a8-485f-b262-21db5827d2b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-quobyte-14e8ed02-59a8-485f-b262-21db5827d2b0" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-14e8ed02-59a8-485f-b262-21db5827d2b0" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e455b249-3a02-4ba8-9459-b09a4d9eb767]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:52 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0
Sep 16 22:02:52 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:52 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:52 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0
Sep 16 22:02:52 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:52 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e8ed02-59a8-485f-b262-21db5827d2b0" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-14e8ed02-59a8-485f-b262-21db5827d2b0" released by "delete_volume" :: held 0.839s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Created reservations ['6650cdcf-c310-4b7d-a97f-35850c0d0293', '2755fc93-621b-4a59-b912-3de23e98e2ce', '8e14bbfd-4ae0-46d0-933b-32322006d53d', 'd3c2ea7b-0b85-4244-8445-2b15c4864c6d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:52 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:52 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:53 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.350s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Deleted volume successfully.
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e5d67da5-ba5f-464b-9725-d7e87daa2f37 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-14e8ed02-59a8-485f-b262-21db5827d2b0-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Acquiring lock "cinder-99abe1f2-857f-47f8-8a7c-e923d01ea08f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "cinder-99abe1f2-857f-47f8-8a7c-e923d01ea08f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (e3c9605f-d115-408c-a4ea-8d8133645c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94955618-6055-427e-986f-1302810e01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94955618-6055-427e-986f-1302810e01f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625315873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22987274-cc74-4b40-8340-afb21e38276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:54Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4a143e-26c5-431b-924a-cfe2f25d3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4a143e-26c5-431b-924a-cfe2f25d3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ed99a2-148c-4c59-ae9d-f3b4fd3b78d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ed99a2-148c-4c59-ae9d-f3b4fd3b78d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22987274-cc74-4b40-8340-afb21e38276f', 'volume_name': 'volume-22987274-cc74-4b40-8340-afb21e38276f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb303d1-b0e3-445c-af43-bb2d427868df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb303d1-b0e3-445c-af43-bb2d427868df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0558ee5-a021-4776-bb66-70a3bf1e65ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:53 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Volume 22987274-cc74-4b40-8340-afb21e38276f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22987274-cc74-4b40-8340-afb21e38276f', 'volume_size': 1}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625315873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22987274-cc74-4b40-8340-afb21e38276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:54Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Creating volume 22987274-cc74-4b40-8340-afb21e38276f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:53 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Acquiring lock "cinder-quobyte-99abe1f2-857f-47f8-8a7c-e923d01ea08f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:53 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f 1073741824
Sep 16 22:02:53 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "cinder-quobyte-99abe1f2-857f-47f8-8a7c-e923d01ea08f" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dee3f6-ffe3-4201-8e29-70f986d0e348]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:54 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f
Sep 16 22:02:54 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:54 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f 1073741824" returned: 0 in 0.536s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:54 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f" returned: 0 in 0.489s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:54 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f
Sep 16 22:02:54 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:54 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f
Sep 16 22:02:54 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:54 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-99abe1f2-857f-47f8-8a7c-e923d01ea08f" returned: 0 in 0.279s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:54 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "cinder-quobyte-99abe1f2-857f-47f8-8a7c-e923d01ea08f" released by "delete_volume" :: held 0.846s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0558ee5-a021-4776-bb66-70a3bf1e65ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22987274-cc74-4b40-8340-afb21e38276f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80dc871-0bd7-49fb-8761-cfff3c3fc414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:54 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Volume volume-22987274-cc74-4b40-8340-afb21e38276f (22987274-cc74-4b40-8340-afb21e38276f): created successfully
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80dc871-0bd7-49fb-8761-cfff3c3fc414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (e3c9605f-d115-408c-a4ea-8d8133645c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2471bf0d-2b1c-4112-a659-e6eef52eb51c tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Created reservations ['03030343-d6a0-4f2d-bda0-4a5781d40ab2', 'b23edb42-f429-4964-8f5d-2930a92dbedb', '1df9ec50-f86d-4326-9fbf-006caaa5503c', '6f1d56c6-c77f-4c3a-a4ce-121586c81662'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:54 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:54 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:55 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Deleted volume successfully.
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3c29c1d6-0d5d-4f62-a940-f0e79683be26 tempest-VolumesMetadataTest-1977555754 None] Lock "cinder-99abe1f2-857f-47f8-8a7c-e923d01ea08f-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "cinder-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "cinder-quobyte-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-quobyte-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe64adfe-0abc-432b-a09c-9d06e5131d19]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:55 devstack sudo[100683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be
Sep 16 22:02:55 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-22987274-cc74-4b40-8340-afb21e38276f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-22987274-cc74-4b40-8340-afb21e38276f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-quobyte-22987274-cc74-4b40-8340-afb21e38276f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-22987274-cc74-4b40-8340-afb21e38276f" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[002cc858-ac6e-4b8d-8794-5bc733224d27]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:56 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" returned: 0 in 0.476s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:56 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be
Sep 16 22:02:56 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:56 devstack sudo[100689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f
Sep 16 22:02:56 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:56 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-quobyte-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be" released by "delete_volume" :: held 0.836s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Created reservations ['93e99099-9c3a-4501-8595-fa111ee618c3', '39c99a09-aebc-4aa7-9b66-49ad54b90cdf', '2511fe59-df33-4144-9449-9243ec1c63c9', '5019d55e-f6c8-48c5-9d50-c18181c721e0'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:56 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:56 devstack sudo[100697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f
Sep 16 22:02:56 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:56 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:56 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "cinder-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "cinder-quobyte-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:02:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-quobyte-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[166b823c-02b2-4642-aec8-5aed3a60badf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:57 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.328s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Deleted volume successfully.
Sep 16 22:02:57 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-86a46ec3-4049-49f6-818a-a0e5cfbdda55 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-ec4117ac-bdfd-4339-90c9-dc4c7f0cb8be-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22987274-cc74-4b40-8340-afb21e38276f" returned: 0 in 0.488s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-22987274-cc74-4b40-8340-afb21e38276f" released by "delete_volume" :: held 1.044s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Created reservations ['4b7af3f7-530e-4fd4-be14-7453f61a5c4a', 'c3e04d4e-2ec0-4b8c-9235-aea4c0721195', '5fd80c54-89f8-4712-880c-4cc46ffa29da', 'b1ecbd87-086e-4e13-b749-f4276db4cdfc'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:57 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb
Sep 16 22:02:57 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:57 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:57 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:57 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:57 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" returned: 0 in 0.571s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Deleted volume successfully.
Sep 16 22:02:57 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb
Sep 16 22:02:57 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed0dcb0b-f6c0-40a7-9191-80e6cd347236 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-22987274-cc74-4b40-8340-afb21e38276f-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:57 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-quobyte-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb" released by "delete_volume" :: held 0.909s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Created reservations ['c954e80d-2763-46c6-8199-00cb6a4605ac', 'ea45b773-0514-452e-8d06-a5d08b5c9eae', '9b5b42cb-9b41-43c0-a206-af1988b67697', '1110fa53-f8be-4deb-8e4d-ed84e588547a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:58 devstack sudo[100714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:02:58 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:58 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:02:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Deleted volume successfully.
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e1e4ba2d-b7de-4827-9aeb-7cf8be2787a2 tempest-TestServerVolumeAttachmentScenario-1977358795 None] Lock "cinder-699cee37-ed8c-4bc7-a4b6-76bcb66e07cb-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (14bcc4f1-47da-49fe-89e1-dff7480967bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22cafc9-65b0-4bdd-8ff1-b2ebf85859af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22cafc9-65b0-4bdd-8ff1-b2ebf85859af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433579542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9eca07-3fa4-4110-bbd9-67ee8be637ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:59Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89352f5c-64aa-4c39-9387-20fe5875d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89352f5c-64aa-4c39-9387-20fe5875d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8fd410-1966-4ef2-b1bd-4928db00d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8fd410-1966-4ef2-b1bd-4928db00d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9eca07-3fa4-4110-bbd9-67ee8be637ee', 'volume_name': 'volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24422a8c-0a6b-4a3f-84f3-175bbfd62905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24422a8c-0a6b-4a3f-84f3-175bbfd62905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de63ed49-88da-4181-844f-d00949455164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Volume fd9eca07-3fa4-4110-bbd9-67ee8be637ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee', 'volume_size': 1}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433579542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9eca07-3fa4-4110-bbd9-67ee8be637ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:02:59Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Creating volume fd9eca07-3fa4-4110-bbd9-67ee8be637ee {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:02:59 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:59 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee 1073741824
Sep 16 22:02:59 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:59 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee 1073741824" returned: 0 in 0.555s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:02:59 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee
Sep 16 22:02:59 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:02:59 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de63ed49-88da-4181-844f-d00949455164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f363d917-e356-4f0c-8143-832198124e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:02:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Volume volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee (fd9eca07-3fa4-4110-bbd9-67ee8be637ee): created successfully
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f363d917-e356-4f0c-8143-832198124e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:02:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (14bcc4f1-47da-49fe-89e1-dff7480967bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d3eb2e04-90e5-474d-b972-c314a98d64be tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-fd9eca07-3fa4-4110-bbd9-67ee8be637ee-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-fd9eca07-3fa4-4110-bbd9-67ee8be637ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "cinder-quobyte-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a74d01-0c64-42d0-804d-10fc42537fde]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:01 devstack sudo[100727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee
Sep 16 22:03:01 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:01 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" returned: 0 in 0.436s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:01 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee
Sep 16 22:03:01 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Flow 'volume_create_manager' (f5b1238b-15bb-4a8b-b0d8-a8f6b98c8c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd8e367-80d3-45ae-a66a-171cc66b6139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd8e367-80d3-45ae-a66a-171cc66b6139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-294800068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480a94ae-d775-46f1-9659-113362bf2103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c45d4a1c74c9ea7b8af356bb8e589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:02Z,use_quota=True,user_id='b6d5774a60e3463186aad48aed1fa526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a812712-b675-41e9-a5fb-9bb0c8cf0427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a812712-b675-41e9-a5fb-9bb0c8cf0427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7518a941-e7ba-4db4-a94f-d0d3e8a29c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7518a941-e7ba-4db4-a94f-d0d3e8a29c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480a94ae-d775-46f1-9659-113362bf2103', 'volume_name': 'volume-480a94ae-d775-46f1-9659-113362bf2103', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9dc552-df55-4472-a88d-0c5302f38c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9dc552-df55-4472-a88d-0c5302f38c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bfa44e-1156-4f7b-94d6-206f28fbba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Volume 480a94ae-d775-46f1-9659-113362bf2103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480a94ae-d775-46f1-9659-113362bf2103', 'volume_size': 1}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-294800068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480a94ae-d775-46f1-9659-113362bf2103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c45d4a1c74c9ea7b8af356bb8e589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:02Z,use_quota=True,user_id='b6d5774a60e3463186aad48aed1fa526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Creating volume 480a94ae-d775-46f1-9659-113362bf2103 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:01 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:01 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 1073741824
Sep 16 22:03:01 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:01 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" returned: 0 in 0.315s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-quobyte-fd9eca07-3fa4-4110-bbd9-67ee8be637ee" released by "delete_volume" :: held 0.801s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Created reservations ['287a982d-8d0f-4d0c-868b-97bfcfa96c1b', 'da51e61d-5c3e-4f2b-b1e8-8577f9e62b3b', 'f8b92c03-74a9-4fb0-92e2-32d55eb805ae', 'ca6a0cc9-a027-4777-bcf0-63dcb3e52173'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:02 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:02 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:02 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 1073741824" returned: 0 in 0.550s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:02 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.333s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Deleted volume successfully.
Sep 16 22:03:02 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103
Sep 16 22:03:02 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0242aa89-e58e-48ec-a396-03598dd43698 tempest-VolumesActionsTest-1702936809 None] Lock "cinder-fd9eca07-3fa4-4110-bbd9-67ee8be637ee-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:02 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bfa44e-1156-4f7b-94d6-206f28fbba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480a94ae-d775-46f1-9659-113362bf2103', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94c3305-b850-4ce7-8ee4-ad7260249907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:02 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Volume volume-480a94ae-d775-46f1-9659-113362bf2103 (480a94ae-d775-46f1-9659-113362bf2103): created successfully
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94c3305-b850-4ce7-8ee4-ad7260249907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Flow 'volume_create_manager' (f5b1238b-15bb-4a8b-b0d8-a8f6b98c8c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-30f7961d-d7aa-4bad-b370-be02b65498cb tempest-VolumesTransfersTest-1083125761 None] Created volume successfully.
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (f38d9424-353e-4767-a964-df79a203d3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1c4dbc-ba8e-42af-8da9-c68ac3d67c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e1c4dbc-ba8e-42af-8da9-c68ac3d67c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665188218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:03Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5785bf-1aee-4340-912b-f4d8635133a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5785bf-1aee-4340-912b-f4d8635133a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ea24e6-a4bd-4b5b-85b2-a0c0f2be9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ea24e6-a4bd-4b5b-85b2-a0c0f2be9a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f', 'volume_name': 'volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55da7035-b3d0-4c6e-830e-3f3321ea798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55da7035-b3d0-4c6e-830e-3f3321ea798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec0b89f-4695-49f5-a26a-5f20951eae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Volume ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f', 'volume_size': 1}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665188218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e417fceb8e24baa8fd29beb5b58371e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:03Z,use_quota=True,user_id='2b80c573d67f491288d4032e814d69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Creating volume ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:03 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f 1073741824
Sep 16 22:03:03 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:03 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f 1073741824" returned: 0 in 0.449s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:03 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f
Sep 16 22:03:03 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:03 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec0b89f-4695-49f5-a26a-5f20951eae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea07675-08d5-4ac0-a633-d482084c924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Volume volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f (ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f): created successfully
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea07675-08d5-4ac0-a633-d482084c924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Flow 'volume_create_manager' (f38d9424-353e-4767-a964-df79a203d3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:03 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-25a8e45c-8973-40e7-87a9-75ed15d183f1 tempest-VolumesActionsTest-1800828164 None] Created volume successfully.
Sep 16 22:03:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2f3a401d-6d05-431b-be88-05dfc70f4271 tempest-VolumesTransfersTest-1330749645 None] Transfer volume completed successfully.
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "cinder-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "cinder-quobyte-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "cinder-quobyte-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498ae29-6db3-456d-aac2-d241de7d757c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:04 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f
Sep 16 22:03:04 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:05 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" returned: 0 in 0.406s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:05 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f
Sep 16 22:03:05 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Acquiring lock "cinder-480a94ae-d775-46f1-9659-113362bf2103-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "cinder-480a94ae-d775-46f1-9659-113362bf2103-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Acquiring lock "cinder-quobyte-480a94ae-d775-46f1-9659-113362bf2103" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "cinder-quobyte-480a94ae-d775-46f1-9659-113362bf2103" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8521450d-40e4-4f86-9a50-5bd2a3d3f500]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:05 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" returned: 0 in 0.292s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "cinder-quobyte-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f" released by "delete_volume" :: held 0.756s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Created reservations ['9c7abb6e-1f2c-49dd-9091-9694781130e8', 'aabbbc27-0532-476f-b730-93ebd6039153', 'd0da424d-15bf-44c2-b4d6-7a86e1e1b04c', '4b3b6105-e248-4155-a725-5db07228a603'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:05 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103
Sep 16 22:03:05 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:05 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:05 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:05 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103" returned: 0 in 0.406s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:05 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103
Sep 16 22:03:05 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:05 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Deleted volume successfully.
Sep 16 22:03:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-28e394a0-0b28-4810-a482-3e34d6acabb5 tempest-VolumesActionsTest-1800828164 None] Lock "cinder-ac4a60dd-c271-49b2-9b2c-05a6d24d8b1f-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:06 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-480a94ae-d775-46f1-9659-113362bf2103" returned: 0 in 0.279s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "cinder-quobyte-480a94ae-d775-46f1-9659-113362bf2103" released by "delete_volume" :: held 0.747s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Created reservations ['ede5d405-b4a4-433d-b55e-29ef78a2dbb2', '86b46362-9b87-4ce4-a22a-0dc387960880', '3762b64f-6485-4bf3-8d0d-82e733c48c5b', '02017090-d1fa-42de-a45f-9952e71f8860'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:06 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:06 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:06 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:06 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Deleted volume successfully.
Sep 16 22:03:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7d993181-007c-477c-8cdd-bb602504c56d tempest-VolumesTransfersTest-798404379 None] Lock "cinder-480a94ae-d775-46f1-9659-113362bf2103-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Flow 'volume_create_manager' (4e9b4664-6184-4918-b124-e9560050d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08c99a-acc1-44e7-a70e-d239c334eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08c99a-acc1-44e7-a70e-d239c334eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1113867485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de299a86-68ba-4534-999f-5ce535671ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c45d4a1c74c9ea7b8af356bb8e589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:07Z,use_quota=True,user_id='b6d5774a60e3463186aad48aed1fa526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac5ffe-7e52-47f7-b829-b7914629f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac5ffe-7e52-47f7-b829-b7914629f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb897b60-d87d-4350-b277-ecab06ece8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb897b60-d87d-4350-b277-ecab06ece8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de299a86-68ba-4534-999f-5ce535671ad7', 'volume_name': 'volume-de299a86-68ba-4534-999f-5ce535671ad7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3aa49e-3290-4b9e-931c-93db0d3d5cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3aa49e-3290-4b9e-931c-93db0d3d5cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116e17d6-ce8d-43e7-a3b9-4d1035538bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Volume de299a86-68ba-4534-999f-5ce535671ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de299a86-68ba-4534-999f-5ce535671ad7', 'volume_size': 1}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1113867485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de299a86-68ba-4534-999f-5ce535671ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172c45d4a1c74c9ea7b8af356bb8e589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:07Z,use_quota=True,user_id='b6d5774a60e3463186aad48aed1fa526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Creating volume de299a86-68ba-4534-999f-5ce535671ad7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:07 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:07 devstack sudo[100783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 1073741824
Sep 16 22:03:07 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:07 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 1073741824" returned: 0 in 0.573s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:07 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7
Sep 16 22:03:07 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:08 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116e17d6-ce8d-43e7-a3b9-4d1035538bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de299a86-68ba-4534-999f-5ce535671ad7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7359b786-f1f3-4b48-835e-7feb3823716f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Volume volume-de299a86-68ba-4534-999f-5ce535671ad7 (de299a86-68ba-4534-999f-5ce535671ad7): created successfully
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7359b786-f1f3-4b48-835e-7feb3823716f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Flow 'volume_create_manager' (4e9b4664-6184-4918-b124-e9560050d04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d0fa1fde-a901-4cea-9374-bf51494c515d tempest-VolumesTransfersTest-1083125761 None] Created volume successfully.
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Acquiring lock "cinder-de299a86-68ba-4534-999f-5ce535671ad7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "cinder-de299a86-68ba-4534-999f-5ce535671ad7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Acquiring lock "cinder-quobyte-de299a86-68ba-4534-999f-5ce535671ad7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "cinder-quobyte-de299a86-68ba-4534-999f-5ce535671ad7" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e174a-8574-42d3-b9a0-7533e65b278a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:09 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7
Sep 16 22:03:09 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:10 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:10 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7
Sep 16 22:03:10 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:10 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-de299a86-68ba-4534-999f-5ce535671ad7" returned: 0 in 0.296s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "cinder-quobyte-de299a86-68ba-4534-999f-5ce535671ad7" released by "delete_volume" :: held 0.805s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Created reservations ['207609d6-9914-4c7e-a76b-b899ea0384e4', '37517088-6b3b-430c-9c6c-1961d5fee67c', '58f23754-7f5e-4b03-81cd-176d41c1a732', '89bf201e-e124-4f72-82a3-241b565a688c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:10 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:10 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:10 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.295s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Deleted volume successfully.
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6cd3c031-cecd-46ba-ae81-b4c897891054 tempest-VolumesTransfersTest-798404379 None] Lock "cinder-de299a86-68ba-4534-999f-5ce535671ad7-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (39cd7f12-177c-4c9b-b869-9de84619f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de07e53-bfa6-4e11-9e92-0528650c5397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de07e53-bfa6-4e11-9e92-0528650c5397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934220844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e8df2c-e68d-41b7-be8e-b0691317160b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:11Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ba26b2-586b-4a1c-a24a-162e8cbc47bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ba26b2-586b-4a1c-a24a-162e8cbc47bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f24b448-d658-4a41-9235-d2c4de3b748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f24b448-d658-4a41-9235-d2c4de3b748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e8df2c-e68d-41b7-be8e-b0691317160b', 'volume_name': 'volume-76e8df2c-e68d-41b7-be8e-b0691317160b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88dff3-68db-4579-a9e8-e329bf7889b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb88dff3-68db-4579-a9e8-e329bf7889b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e2e49-edfe-4d61-a2bd-0c84211a0452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Volume 76e8df2c-e68d-41b7-be8e-b0691317160b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e8df2c-e68d-41b7-be8e-b0691317160b', 'volume_size': 1}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934220844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e8df2c-e68d-41b7-be8e-b0691317160b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:11Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Creating volume 76e8df2c-e68d-41b7-be8e-b0691317160b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:11 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:11 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b 1073741824
Sep 16 22:03:11 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (ceacc3a4-f2a4-4a4c-90df-eb05a4192582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d758f-8743-42ff-b713-152add38d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d758f-8743-42ff-b713-152add38d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608603513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a214304a-5574-45b8-9b26-57d03f8207f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:12Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9cd566-97f2-4040-addf-10b78c0cee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9cd566-97f2-4040-addf-10b78c0cee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410969d5-f738-4540-9dfc-7cca478f773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410969d5-f738-4540-9dfc-7cca478f773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a214304a-5574-45b8-9b26-57d03f8207f7', 'volume_name': 'volume-a214304a-5574-45b8-9b26-57d03f8207f7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a833fb34-eeec-4fb5-bc42-32272ee633b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a833fb34-eeec-4fb5-bc42-32272ee633b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b07fdc9-b2b6-4f44-b2bd-5a8f7b66c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Volume a214304a-5574-45b8-9b26-57d03f8207f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a214304a-5574-45b8-9b26-57d03f8207f7', 'volume_size': 1}
Sep 16 22:03:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:12 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b 1073741824" returned: 0 in 0.702s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:12 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b
Sep 16 22:03:12 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (0d40a4a8-b909-4e50-8ae0-e166be62589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c558fa1-0d1f-4d70-8eb7-10151ea03483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c558fa1-0d1f-4d70-8eb7-10151ea03483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-794223217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29432637-3182-4b3c-9154-0cc77be6737f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:12Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5d01a4-2b15-40f5-96ad-e01c95d61230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5d01a4-2b15-40f5-96ad-e01c95d61230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6924c003-6bde-4b6c-812b-9fe5f9365dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6924c003-6bde-4b6c-812b-9fe5f9365dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29432637-3182-4b3c-9154-0cc77be6737f', 'volume_name': 'volume-29432637-3182-4b3c-9154-0cc77be6737f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e92bd08-b06d-4f75-8219-89373116a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e92bd08-b06d-4f75-8219-89373116a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b302492-ea0c-4a69-b19c-78b9785019fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Volume 29432637-3182-4b3c-9154-0cc77be6737f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29432637-3182-4b3c-9154-0cc77be6737f', 'volume_size': 1}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b" returned: 0 in 0.469s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608603513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a214304a-5574-45b8-9b26-57d03f8207f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:12Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Creating volume a214304a-5574-45b8-9b26-57d03f8207f7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:12 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e2e49-edfe-4d61-a2bd-0c84211a0452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e8df2c-e68d-41b7-be8e-b0691317160b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 1073741824
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8b8a6a-61e3-4471-b8af-cdd494e1c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:12 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Volume volume-76e8df2c-e68d-41b7-be8e-b0691317160b (76e8df2c-e68d-41b7-be8e-b0691317160b): created successfully
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8b8a6a-61e3-4471-b8af-cdd494e1c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (39cd7f12-177c-4c9b-b869-9de84619f220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2cf1c553-dd2e-4d6f-a276-b0668e7c3894 tempest-CreateVolumesFromImageTest-219744760 None] Created volume successfully.
Sep 16 22:03:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (a77d6d18-ac67-49e9-a20a-77b328599865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5616e395-9e68-4b0f-a52f-3315228cf45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5616e395-9e68-4b0f-a52f-3315228cf45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455339231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe87dc14-348c-4923-89a8-85404f86121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:13Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee57ac0-26af-44be-855d-167f58fefd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee57ac0-26af-44be-855d-167f58fefd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb1327c-50e9-4a2c-b56a-ab1a1e91252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb1327c-50e9-4a2c-b56a-ab1a1e91252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe87dc14-348c-4923-89a8-85404f86121d', 'volume_name': 'volume-fe87dc14-348c-4923-89a8-85404f86121d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a10c08-fbe8-4542-8bd5-bd36732c58bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a10c08-fbe8-4542-8bd5-bd36732c58bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112312b8-b841-45e2-bcad-6990728041b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Volume fe87dc14-348c-4923-89a8-85404f86121d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe87dc14-348c-4923-89a8-85404f86121d', 'volume_size': 1}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:13 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 1073741824" returned: 0 in 0.748s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:13 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7
Sep 16 22:03:13 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (72eae635-ae2e-473b-8324-53ba19a98da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da512954-894e-45b1-80a1-f45699367d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da512954-894e-45b1-80a1-f45699367d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114018860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808faff-3526-4c00-8061-22f9be10d807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:13Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87da9e86-32d8-4965-a854-13ef5fba2b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87da9e86-32d8-4965-a854-13ef5fba2b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a5855-8f06-4af4-ab37-ed423726f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a5855-8f06-4af4-ab37-ed423726f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3808faff-3526-4c00-8061-22f9be10d807', 'volume_name': 'volume-3808faff-3526-4c00-8061-22f9be10d807', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb730b-c7ac-47bc-a13a-aefb5cadcf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb730b-c7ac-47bc-a13a-aefb5cadcf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1682a0b4-9f59-465d-9553-b1442de0076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Volume 3808faff-3526-4c00-8061-22f9be10d807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3808faff-3526-4c00-8061-22f9be10d807', 'volume_size': 1}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:13 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.169s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-794223217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29432637-3182-4b3c-9154-0cc77be6737f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:12Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Creating volume 29432637-3182-4b3c-9154-0cc77be6737f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:13 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b07fdc9-b2b6-4f44-b2bd-5a8f7b66c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a214304a-5574-45b8-9b26-57d03f8207f7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f 1073741824
Sep 16 22:03:13 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693761f2-8596-48e1-8e5a-fb852aaed3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Volume volume-a214304a-5574-45b8-9b26-57d03f8207f7 (a214304a-5574-45b8-9b26-57d03f8207f7): created successfully
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693761f2-8596-48e1-8e5a-fb852aaed3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (ceacc3a4-f2a4-4a4c-90df-eb05a4192582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dbd4f2c2-b5e2-470b-ba79-e2bd2d5621a0 tempest-CreateVolumesFromImageTest-219744760 None] Created volume successfully.
Sep 16 22:03:14 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f 1073741824" returned: 0 in 0.529s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=174,cinder:SELECT=137,cinder:INSERT=41,cinder:DELETE=15 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=126,cinder:UPDATE=173,cinder:DELETE=15,cinder:INSERT=36 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:14 devstack sudo[100832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f
Sep 16 22:03:14 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:14 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455339231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe87dc14-348c-4923-89a8-85404f86121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:13Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Creating volume fe87dc14-348c-4923-89a8-85404f86121d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b302492-ea0c-4a69-b19c-78b9785019fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29432637-3182-4b3c-9154-0cc77be6737f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:14 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d 1073741824
Sep 16 22:03:14 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958aa03-1614-4f26-b669-e770815f4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Volume volume-29432637-3182-4b3c-9154-0cc77be6737f (29432637-3182-4b3c-9154-0cc77be6737f): created successfully
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958aa03-1614-4f26-b669-e770815f4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (0d40a4a8-b909-4e50-8ae0-e166be62589b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ac27cf0e-f336-49ab-92fe-4caa8dc31832 tempest-CreateVolumesFromImageTest-219744760 None] Created volume successfully.
Sep 16 22:03:15 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d 1073741824" returned: 0 in 0.562s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:15 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d
Sep 16 22:03:15 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:15 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d" returned: 0 in 0.294s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114018860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808faff-3526-4c00-8061-22f9be10d807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41925bec4b2143b7a94f9d202cf212ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:13Z,use_quota=True,user_id='5c5232a5d5f846f08c4f09690bd6ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Creating volume 3808faff-3526-4c00-8061-22f9be10d807 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:15 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:15 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 1073741824
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112312b8-b841-45e2-bcad-6990728041b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe87dc14-348c-4923-89a8-85404f86121d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:15 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2732c59d-6079-4590-adf6-e0f8a7ae8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Volume volume-fe87dc14-348c-4923-89a8-85404f86121d (fe87dc14-348c-4923-89a8-85404f86121d): created successfully
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2732c59d-6079-4590-adf6-e0f8a7ae8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (a77d6d18-ac67-49e9-a20a-77b328599865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-53e44997-0af5-41c1-a20b-fff9b9858ab5 tempest-CreateVolumesFromImageTest-219744760 None] Created volume successfully.
Sep 16 22:03:16 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 1073741824" returned: 0 in 0.605s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:16 devstack sudo[100851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807
Sep 16 22:03:16 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:16 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807" returned: 0 in 0.281s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1682a0b4-9f59-465d-9553-b1442de0076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3808faff-3526-4c00-8061-22f9be10d807', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627cfd3-bfb1-4439-b1a2-bf8b06e67da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Volume volume-3808faff-3526-4c00-8061-22f9be10d807 (3808faff-3526-4c00-8061-22f9be10d807): created successfully
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627cfd3-bfb1-4439-b1a2-bf8b06e67da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Flow 'volume_create_manager' (72eae635-ae2e-473b-8324-53ba19a98da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a1c64d0e-7d84-400b-860a-f03c4c857bd2 tempest-CreateVolumesFromImageTest-219744760 None] Created volume successfully.
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-3808faff-3526-4c00-8061-22f9be10d807-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-3808faff-3526-4c00-8061-22f9be10d807-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-quobyte-3808faff-3526-4c00-8061-22f9be10d807" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-3808faff-3526-4c00-8061-22f9be10d807" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[705febbb-75d5-4dcd-844c-2b6aec78c788]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:17 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807
Sep 16 22:03:17 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:17 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807" returned: 0 in 0.421s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:17 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807
Sep 16 22:03:17 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:17 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-3808faff-3526-4c00-8061-22f9be10d807" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-3808faff-3526-4c00-8061-22f9be10d807" released by "delete_volume" :: held 0.764s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Created reservations ['338f8d39-7b81-4d52-83f3-840cde2c4a74', 'a65025ae-e581-4220-a261-b89a0a65eb4a', '16d6bc8a-a776-4989-9df0-de3d9a31ff0a', '35aed67e-8077-4edd-809f-60472c119939'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:18 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:18 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-fe87dc14-348c-4923-89a8-85404f86121d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-fe87dc14-348c-4923-89a8-85404f86121d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-quobyte-fe87dc14-348c-4923-89a8-85404f86121d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-fe87dc14-348c-4923-89a8-85404f86121d" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2129eb-d56f-4f9e-92aa-fa8c5beb8d1e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:18 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.382s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Deleted volume successfully.
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0c9d4231-38ec-46b1-9b48-c4061f03a64c tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-3808faff-3526-4c00-8061-22f9be10d807-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:18 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d
Sep 16 22:03:18 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:18 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d" returned: 0 in 0.446s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:18 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d
Sep 16 22:03:18 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:19 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-fe87dc14-348c-4923-89a8-85404f86121d" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-fe87dc14-348c-4923-89a8-85404f86121d" released by "delete_volume" :: held 0.766s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Created reservations ['63483a3f-18db-4e97-8231-64dd4ba10eb9', 'cab17a89-a4ef-4535-b85c-8912ed8dda1b', '65ae58f7-c1c0-4527-bac4-9e9119c1e9d3', '50e6d2f8-27e4-4e1e-97e2-5e84ee931a16'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:19 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:19 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-29432637-3182-4b3c-9154-0cc77be6737f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-29432637-3182-4b3c-9154-0cc77be6737f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:19 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-quobyte-29432637-3182-4b3c-9154-0cc77be6737f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.341s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Deleted volume successfully.
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-29432637-3182-4b3c-9154-0cc77be6737f" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2dc9c265-21c1-4a6f-9ac4-3039dc87a8aa tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-fe87dc14-348c-4923-89a8-85404f86121d-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3501ee1c-8881-4b4a-8df1-7e31e9e1565d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:19 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f
Sep 16 22:03:19 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:19 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f" returned: 0 in 0.400s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:20 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f
Sep 16 22:03:20 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:20 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-29432637-3182-4b3c-9154-0cc77be6737f" returned: 0 in 0.302s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-29432637-3182-4b3c-9154-0cc77be6737f" released by "delete_volume" :: held 0.762s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Created reservations ['173c0b27-467c-493b-977d-9803c87fa222', '20a4f746-da3a-4174-a1ab-7d05b4478de9', '36e3a8b8-0d37-4b44-9a9b-e37a7fd01a10', '2df021d1-c9a4-4f04-b4d9-07f3cf556660'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:20 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:20 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-a214304a-5574-45b8-9b26-57d03f8207f7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-a214304a-5574-45b8-9b26-57d03f8207f7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-quobyte-a214304a-5574-45b8-9b26-57d03f8207f7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-a214304a-5574-45b8-9b26-57d03f8207f7" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:20 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Deleted volume successfully.
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b488961-6c64-471a-979e-3907e69aa1c4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01f188ec-5188-4990-810a-583e682864b2 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-29432637-3182-4b3c-9154-0cc77be6737f-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Flow 'volume_create_manager' (f2040e46-b43b-4202-a53a-d2d50f0ce7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179dfad-efe1-4753-86a9-0a4399384c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8179dfad-efe1-4753-86a9-0a4399384c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-428248471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff0d75-9ad4-46be-a874-949bdc154659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242760abb4864c3d8c0eccdae23ab648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:21Z,use_quota=True,user_id='65a674879d1045cd95eb41c2db43fe26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e2d97d-7ff9-4154-a160-66dedbc7fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e2d97d-7ff9-4154-a160-66dedbc7fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20649b6-9113-47d6-a591-ddb48515d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20649b6-9113-47d6-a591-ddb48515d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fff0d75-9ad4-46be-a874-949bdc154659', 'volume_name': 'volume-6fff0d75-9ad4-46be-a874-949bdc154659', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add8ae3c-ad2b-4abb-9ae0-7e0c9e3b7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add8ae3c-ad2b-4abb-9ae0-7e0c9e3b7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:20 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7
Sep 16 22:03:21 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e299abe-a023-4aad-af90-4a27e5322f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Volume 6fff0d75-9ad4-46be-a874-949bdc154659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fff0d75-9ad4-46be-a874-949bdc154659', 'volume_size': 1}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-428248471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fff0d75-9ad4-46be-a874-949bdc154659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242760abb4864c3d8c0eccdae23ab648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:21Z,use_quota=True,user_id='65a674879d1045cd95eb41c2db43fe26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Creating volume 6fff0d75-9ad4-46be-a874-949bdc154659 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:21 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:21 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 1073741824
Sep 16 22:03:21 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:21 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7" returned: 0 in 0.413s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:21 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7
Sep 16 22:03:21 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:21 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 1073741824" returned: 0 in 0.487s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:21 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a214304a-5574-45b8-9b26-57d03f8207f7" returned: 0 in 0.289s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:21 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659
Sep 16 22:03:21 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-a214304a-5574-45b8-9b26-57d03f8207f7" released by "delete_volume" :: held 0.764s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Created reservations ['e7313c0b-c25c-403a-9483-ee3ec5db436d', '8661abbc-0d87-4b9f-a4a0-a5c31209eefd', '9b7177e3-8fb8-439e-aabf-b48bb738f2fb', 'b6112046-884d-430e-913e-2332022f543d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:21 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:21 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:21 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659" returned: 0 in 0.297s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e299abe-a023-4aad-af90-4a27e5322f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fff0d75-9ad4-46be-a874-949bdc154659', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5744f448-701f-436e-9c30-fb4c5273834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Volume volume-6fff0d75-9ad4-46be-a874-949bdc154659 (6fff0d75-9ad4-46be-a874-949bdc154659): created successfully
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5744f448-701f-436e-9c30-fb4c5273834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Flow 'volume_create_manager' (f2040e46-b43b-4202-a53a-d2d50f0ce7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-76e8df2c-e68d-41b7-be8e-b0691317160b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8d30d4e0-a558-485c-95be-51b9f62728cf tempest-VolumesTransfersV355Test-1101839351 None] Created volume successfully.
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-76e8df2c-e68d-41b7-be8e-b0691317160b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:22 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:22 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "cinder-quobyte-76e8df2c-e68d-41b7-be8e-b0691317160b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-76e8df2c-e68d-41b7-be8e-b0691317160b" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:22 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Deleted volume successfully.
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eab592-c7cf-48f3-af4b-c34cde582ca5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-acaf8312-2190-4913-846c-c0b4c173b025 tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-a214304a-5574-45b8-9b26-57d03f8207f7-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:22 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b
Sep 16 22:03:22 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:22 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:03:22 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b" returned: 0 in 0.394s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:22 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b
Sep 16 22:03:22 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:22 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-76e8df2c-e68d-41b7-be8e-b0691317160b" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-quobyte-76e8df2c-e68d-41b7-be8e-b0691317160b" released by "delete_volume" :: held 0.724s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Created reservations ['fe5d132c-5a5b-4dd1-826b-aa573327456f', 'a8c3076a-d1eb-4c55-b3d6-72aec6678b03', 'd4811349-c5fb-4462-b882-cca9d9f583df', '14003121-3901-49da-b698-6c44eb92534a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:22 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:22 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:23 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.271s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:23 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Deleted volume successfully.
Sep 16 22:03:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f86e410d-7611-455e-ab93-b350d189269a tempest-CreateVolumesFromImageTest-219744760 None] Lock "cinder-76e8df2c-e68d-41b7-be8e-b0691317160b-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0b246fc0-44d9-4455-a1e3-811629bace51 tempest-VolumesTransfersV355Test-1577294232 None] Transfer volume completed successfully.
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "cinder-6fff0d75-9ad4-46be-a874-949bdc154659-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-6fff0d75-9ad4-46be-a874-949bdc154659-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "cinder-quobyte-6fff0d75-9ad4-46be-a874-949bdc154659" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-quobyte-6fff0d75-9ad4-46be-a874-949bdc154659" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3234277-4942-47ec-950c-eaf8fad530d9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (6dcd3ea7-0d5d-4807-9390-bd4a54f7b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0f348c-1751-4254-9cd6-8c6b7e2e39c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0f348c-1751-4254-9cd6-8c6b7e2e39c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-431022903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7813e25f-4ec0-4148-981e-5518b8d718f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:25Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d07ba0-8adf-4d15-a1d9-da395bc1518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d07ba0-8adf-4d15-a1d9-da395bc1518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39d03cb-1b13-4ac2-be96-4395488228e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39d03cb-1b13-4ac2-be96-4395488228e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7813e25f-4ec0-4148-981e-5518b8d718f3', 'volume_name': 'volume-7813e25f-4ec0-4148-981e-5518b8d718f3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a70cfb-0755-4627-a287-5edcbef4f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a70cfb-0755-4627-a287-5edcbef4f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be691ac7-8e9e-4b21-955e-104294f248db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Volume 7813e25f-4ec0-4148-981e-5518b8d718f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7813e25f-4ec0-4148-981e-5518b8d718f3', 'volume_size': 1}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-431022903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7813e25f-4ec0-4148-981e-5518b8d718f3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:25Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Creating volume 7813e25f-4ec0-4148-981e-5518b8d718f3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:24 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659
Sep 16 22:03:24 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:24 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:24 devstack sudo[100927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 1073741824
Sep 16 22:03:24 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:25 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:25 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659
Sep 16 22:03:25 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:25 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 1073741824" returned: 0 in 0.485s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:25 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3
Sep 16 22:03:25 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:25 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6fff0d75-9ad4-46be-a874-949bdc154659" returned: 0 in 0.277s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-quobyte-6fff0d75-9ad4-46be-a874-949bdc154659" released by "delete_volume" :: held 0.765s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Created reservations ['abd2a3c9-acc3-4123-af4d-65ac911dd8a1', '7c3609ae-cbc1-45a2-b8ef-ff99a2f980ae', 'dc9c7a82-83c1-4271-a45d-c583dc6ea22c', 'e0c5e580-9cb7-4416-8822-eb32ce2a7ee6'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:25 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:25 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:25 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be691ac7-8e9e-4b21-955e-104294f248db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7813e25f-4ec0-4148-981e-5518b8d718f3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ddabe-b70a-4b8e-8aa3-3352cace1a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Volume volume-7813e25f-4ec0-4148-981e-5518b8d718f3 (7813e25f-4ec0-4148-981e-5518b8d718f3): created successfully
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ddabe-b70a-4b8e-8aa3-3352cace1a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (6dcd3ea7-0d5d-4807-9390-bd4a54f7b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ff078672-04b2-4b05-bcfa-e37dcdb50e0a tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:03:26 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.287s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Deleted volume successfully.
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18a66489-0113-438a-9e19-33d8bbbe2b38 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-6fff0d75-9ad4-46be-a874-949bdc154659-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Flow 'volume_create_manager' (3fad8267-9401-4f06-8849-1c538438a1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25135baf-e5fb-4406-96ad-59b675f49b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25135baf-e5fb-4406-96ad-59b675f49b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541432099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a185ed32-b31f-40d8-a3c3-c62c50cd8117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242760abb4864c3d8c0eccdae23ab648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:26Z,use_quota=True,user_id='65a674879d1045cd95eb41c2db43fe26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ec79fc-91df-425d-a4e4-5fb2257797f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ec79fc-91df-425d-a4e4-5fb2257797f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf91662c-f2cb-47dc-8e50-19456284e1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf91662c-f2cb-47dc-8e50-19456284e1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a185ed32-b31f-40d8-a3c3-c62c50cd8117', 'volume_name': 'volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6742845-285f-4e99-993a-48721846615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6742845-285f-4e99-993a-48721846615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1108d545-a3c5-4a40-88a6-e372f82de7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Volume a185ed32-b31f-40d8-a3c3-c62c50cd8117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117', 'volume_size': 1}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-541432099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a185ed32-b31f-40d8-a3c3-c62c50cd8117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242760abb4864c3d8c0eccdae23ab648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:26Z,use_quota=True,user_id='65a674879d1045cd95eb41c2db43fe26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Creating volume a185ed32-b31f-40d8-a3c3-c62c50cd8117 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:26 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:26 devstack sudo[100947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 1073741824
Sep 16 22:03:26 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:27 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 1073741824" returned: 0 in 0.483s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:27 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117
Sep 16 22:03:27 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:27 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117" returned: 0 in 0.266s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1108d545-a3c5-4a40-88a6-e372f82de7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d180d-0af4-4cbb-86ba-69f9f0ff0733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Volume volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 (a185ed32-b31f-40d8-a3c3-c62c50cd8117): created successfully
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69d180d-0af4-4cbb-86ba-69f9f0ff0733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Flow 'volume_create_manager' (3fad8267-9401-4f06-8849-1c538438a1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a313c638-93a6-4a45-82f3-1d052c16b635 tempest-VolumesTransfersV355Test-1101839351 None] Created volume successfully.
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (ba6b4f58-aa8e-466c-9b2f-684a6c4ff65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6062b26f-c4c7-4cb7-b4ee-25dbdd7b1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6062b26f-c4c7-4cb7-b4ee-25dbdd7b1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-58104164',display_name='tempest-VolumesGetTest-Volume-918678736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798c43b6-e10b-456c-947f-1b2202ad6106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:28Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f38207-1453-4b7e-b7a6-dd9c535feff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f38207-1453-4b7e-b7a6-dd9c535feff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1ea4c-33dd-4b89-ba6b-7bf58573738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1ea4c-33dd-4b89-ba6b-7bf58573738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798c43b6-e10b-456c-947f-1b2202ad6106', 'volume_name': 'volume-798c43b6-e10b-456c-947f-1b2202ad6106', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac62a50-9740-4b53-93ec-4d456375dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac62a50-9740-4b53-93ec-4d456375dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9934dde1-f2ab-414b-b76f-dc9dfe936a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:27 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Volume 798c43b6-e10b-456c-947f-1b2202ad6106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798c43b6-e10b-456c-947f-1b2202ad6106', 'volume_size': 1}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-58104164',display_name='tempest-VolumesGetTest-Volume-918678736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798c43b6-e10b-456c-947f-1b2202ad6106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:28Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Creating volume 798c43b6-e10b-456c-947f-1b2202ad6106 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:27 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:27 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 1073741824
Sep 16 22:03:27 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:28 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 1073741824" returned: 0 in 0.443s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:28 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106
Sep 16 22:03:28 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:28 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106" returned: 0 in 0.314s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9934dde1-f2ab-414b-b76f-dc9dfe936a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798c43b6-e10b-456c-947f-1b2202ad6106', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0411a8-1190-4aec-8eb2-56eed7f187ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:28 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Volume volume-798c43b6-e10b-456c-947f-1b2202ad6106 (798c43b6-e10b-456c-947f-1b2202ad6106): created successfully
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0411a8-1190-4aec-8eb2-56eed7f187ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (ba6b4f58-aa8e-466c-9b2f-684a6c4ff65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-21cbd5dd-114d-480c-9916-58c1432f2f77 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "cinder-a185ed32-b31f-40d8-a3c3-c62c50cd8117-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-a185ed32-b31f-40d8-a3c3-c62c50cd8117-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Flow 'volume_create_manager' (bcaa83c8-4b91-4d98-aa40-b8c8d0c51666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb591c20-ff5c-4c86-847b-1db414a98999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb591c20-ff5c-4c86-847b-1db414a98999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bacc6dc-9dd2-4d3a-8656-1a60a85aa870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6e8c3a7e6e493f8dc6b4e0b117117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:29Z,use_quota=True,user_id='65ade64c158a46048020554be54155bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecddb557-71d2-4ec0-a0de-d23ab99a4407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecddb557-71d2-4ec0-a0de-d23ab99a4407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8af4f2-b5f4-471d-8f10-5a5eefab3dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "cinder-quobyte-a185ed32-b31f-40d8-a3c3-c62c50cd8117" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-quobyte-a185ed32-b31f-40d8-a3c3-c62c50cd8117" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a1bf8c-d205-411d-8297-be660c40d080]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:29 devstack sudo[100965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117
Sep 16 22:03:29 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8af4f2-b5f4-471d-8f10-5a5eefab3dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bacc6dc-9dd2-4d3a-8656-1a60a85aa870', 'volume_name': 'volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870', 'volume_size': 1, 'image_id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a63469fc49e880306e7bf67fc42bd8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f6e8c3a7e6e493f8dc6b4e0b117117b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25a6b266f4beda3259e0863eed5a692c3918e79c43290bf4f3208f2a5a786539ee8b5f2959cc7a130c96f62b0598834d8e75505eb517cbf60e186641ea3ed576', 'id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'created_at': datetime.datetime(2026, 9, 16, 20, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5aa2870>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22815bd6-d132-468f-abe6-8eb6c25ff529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22815bd6-d132-468f-abe6-8eb6c25ff529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab957e4b-75ab-4693-af7f-c9018a080ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:29 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870', 'volume_size': 1, 'image_id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a63469fc49e880306e7bf67fc42bd8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f6e8c3a7e6e493f8dc6b4e0b117117b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25a6b266f4beda3259e0863eed5a692c3918e79c43290bf4f3208f2a5a786539ee8b5f2959cc7a130c96f62b0598834d8e75505eb517cbf60e186641ea3ed576', 'id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'created_at': datetime.datetime(2026, 9, 16, 20, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5aa2870>}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Trying to clone 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 from image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:03:29 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e561640d-ca71-4e1c-b3b5-51e2844e50d8]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:29 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:29 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117
Sep 16 22:03:29 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:29 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:29 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:29 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:29 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a185ed32-b31f-40d8-a3c3-c62c50cd8117" returned: 0 in 0.263s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-quobyte-a185ed32-b31f-40d8-a3c3-c62c50cd8117" released by "delete_volume" :: held 0.691s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Created reservations ['b90ec045-340e-4971-ae86-e22efa64b61f', '54c690a8-9063-4e91-a5cc-f0f6cfa53dff', 'f3050558-b9ab-438a-a5a3-6b81827ebd3e', '84579ebc-906a-4bf3-a015-b0148968a4e0'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:29 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:29 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:29 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:29 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:29 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:03:29 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Temporary image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 is fetched for user 65ade64c158a46048020554be54155bf. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-798c43b6-e10b-456c-947f-1b2202ad6106-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:30 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.311s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "cinder-798c43b6-e10b-456c-947f-1b2202ad6106-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:30 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Deleted volume successfully.
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce61a6d3-27e4-4821-bf03-404fb044cc71]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-798c43b6-e10b-456c-947f-1b2202ad6106" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7494c14b-683c-4221-9695-626c34c20461 tempest-VolumesTransfersV355Test-929685378 None] Lock "cinder-a185ed32-b31f-40d8-a3c3-c62c50cd8117-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-798c43b6-e10b-456c-947f-1b2202ad6106" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46bacc-87b1-4881-871c-4577a29cd3cf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:30 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:30 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:30 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106
Sep 16 22:03:30 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:30 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:30 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:30 devstack sudo[100991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:30 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:30 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106
Sep 16 22:03:30 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:30 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-798c43b6-e10b-456c-947f-1b2202ad6106" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:30 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bacc6dc-9dd2-4d3a-8656-1a60a85aa870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6e8c3a7e6e493f8dc6b4e0b117117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:29Z,use_quota=True,user_id='65ade64c158a46048020554be54155bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Creating volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:30 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-798c43b6-e10b-456c-947f-1b2202ad6106" released by "delete_volume" :: held 0.759s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:30 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1073741824
Sep 16 22:03:30 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:30 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Created reservations ['1834be00-5f8a-4b1d-a793-6deb294ba94b', 'c9abcf95-3aff-4457-b285-df6bc032e216', '0c3f44fc-0f74-4cb1-95e3-b66fc0287199', '67c3401f-f5eb-4186-aa3b-4f0916939379'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:31 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:31 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-7813e25f-4ec0-4148-981e-5518b8d718f3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:31 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "cinder-7813e25f-4ec0-4148-981e-5518b8d718f3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.311s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b143eb1a-c82a-4943-929c-c1c0d64aa1b2 tempest-VolumesGetTest-1863225850 None] Lock "cinder-798c43b6-e10b-456c-947f-1b2202ad6106-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-7813e25f-4ec0-4148-981e-5518b8d718f3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-7813e25f-4ec0-4148-981e-5518b8d718f3" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:31 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1073741824" returned: 0 in 0.567s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[097fc0c7-141b-46bb-b045-3a66f0da70b7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:31 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870
Sep 16 22:03:31 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:31 devstack sudo[101012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3
Sep 16 22:03:31 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:31 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" returned: 0 in 0.292s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Attempting download of 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 ((None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}])) to volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:03:31 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3" returned: 0 in 0.416s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:31 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3
Sep 16 22:03:31 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452f965-248e-4865-b97a-1cdfdab8020e]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:32 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n
Sep 16 22:03:32 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:32 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7813e25f-4ec0-4148-981e-5518b8d718f3" returned: 0 in 0.270s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-7813e25f-4ec0-4148-981e-5518b8d718f3" released by "delete_volume" :: held 0.745s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Created reservations ['be470110-63a8-46a9-9d35-645e10e3b2db', '5e827ac1-ab1f-4a9c-b274-ab0c15ec33fb', '7e373477-66f4-4ebb-80b6-7c130f16612f', 'bda8b4e2-1f7d-4917-9561-371765ba4fcd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:32 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:32 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:32 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:32 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n
Sep 16 22:03:32 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:32 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.316s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:03:32 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n" returned: 1 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_fj4jb__n' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[08797dc3-6a86-4247-a1fa-3754f8787572]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fb881c39-c6f1-44d5-83a2-e6c026ec7e17 tempest-VolumesGetTest-1863225850 None] Lock "cinder-7813e25f-4ec0-4148-981e-5518b8d718f3-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:32 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:32 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (c2d32c6f-c873-43b6-bc2e-752ae116b88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6b0720-f3e8-459d-8dc2-38031eeafec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:33 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6b0720-f3e8-459d-8dc2-38031eeafec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-863826546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73604f03-40b3-444c-95eb-4427a5c200ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:33Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee6e8-80d7-4f8c-a6ed-ae10c509039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee6e8-80d7-4f8c-a6ed-ae10c509039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c98b3d8-7078-4775-8e0d-6d659510cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c98b3d8-7078-4775-8e0d-6d659510cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73604f03-40b3-444c-95eb-4427a5c200ac', 'volume_name': 'volume-73604f03-40b3-444c-95eb-4427a5c200ac', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22088e-6c9a-429a-86ff-a32f14801264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e22088e-6c9a-429a-86ff-a32f14801264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccc3427-b973-41db-8aee-f70f65730abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Volume 73604f03-40b3-444c-95eb-4427a5c200ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73604f03-40b3-444c-95eb-4427a5c200ac', 'volume_size': 1}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-863826546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73604f03-40b3-444c-95eb-4427a5c200ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:33Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Creating volume 73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:33 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:33 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac 1073741824
Sep 16 22:03:33 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:33 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD
Sep 16 22:03:33 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:33 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 was raw, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:33 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870
Sep 16 22:03:33 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:33 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac 1073741824" returned: 0 in 0.497s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:33 devstack sudo[101053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:33 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:33 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccc3427-b973-41db-8aee-f70f65730abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73604f03-40b3-444c-95eb-4427a5c200ac', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd1e486-cf3a-4085-8e27-f9d8ca0d6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:34 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Volume volume-73604f03-40b3-444c-95eb-4427a5c200ac (73604f03-40b3-444c-95eb-4427a5c200ac): created successfully
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd1e486-cf3a-4085-8e27-f9d8ca0d6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (c2d32c6f-c873-43b6-bc2e-752ae116b88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:34 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-471b563f-64ec-439e-b8ff-daf004bf0db9 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:03:34 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" returned: 0 in 0.551s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58c7bfdd-65bd-49cd-b53a-4fd4ef587081_gv6z21ordevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:03:34 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:34 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1G
Sep 16 22:03:34 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:34 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 1G" returned: 0 in 0.340s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Downloaded image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 ((None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}])) to volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Temporary image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 for user 65ade64c158a46048020554be54155bf is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Marking volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Copying metadata from image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 to 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Creating volume glance metadata for volume 9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 backed by image 58c7bfdd-65bd-49cd-b53a-4fd4ef587081 with: {'image_id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5a63469fc49e880306e7bf67fc42bd8d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab957e4b-75ab-4693-af7f-c9018a080ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870', 'volume_size': 1, 'image_id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a63469fc49e880306e7bf67fc42bd8d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8f6e8c3a7e6e493f8dc6b4e0b117117b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25a6b266f4beda3259e0863eed5a692c3918e79c43290bf4f3208f2a5a786539ee8b5f2959cc7a130c96f62b0598834d8e75505eb517cbf60e186641ea3ed576', 'id': '58c7bfdd-65bd-49cd-b53a-4fd4ef587081', 'created_at': datetime.datetime(2026, 9, 16, 20, 3, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58c7bfdd-65bd-49cd-b53a-4fd4ef587081/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5aa2870>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b27034-c0d4-4dea-88a4-e0a4f310864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:34 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Volume volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 (9bacc6dc-9dd2-4d3a-8656-1a60a85aa870): created successfully
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b27034-c0d4-4dea-88a4-e0a4f310864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Flow 'volume_create_manager' (bcaa83c8-4b91-4d98-aa40-b8c8d0c51666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:34 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-10f87f75-2666-4661-8e00-1f9d95e9becc tempest-VolumeImageDependencyTests-1803679857 None] Created volume successfully.
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Acquiring lock "cinder-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "cinder-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Acquiring lock "cinder-quobyte-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "cinder-quobyte-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a318fb-6757-470a-b01c-40666d510221]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:35 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870
Sep 16 22:03:35 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (816e9ffb-1167-4759-b562-91e429edd459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006bbe30-f870-4c1e-81d7-daa0c6f5932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006bbe30-f870-4c1e-81d7-daa0c6f5932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1184910142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d86d4a35-1e9b-457e-82df-12368f4f2d59,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=73604f03-40b3-444c-95eb-4427a5c200ac,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:36Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb9dc0f-e92e-45c9-91a3-e61878812f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb9dc0f-e92e-45c9-91a3-e61878812f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df88c84f-56cb-4fa3-ad7f-f09bbcdfce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df88c84f-56cb-4fa3-ad7f-f09bbcdfce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd86d4a35-1e9b-457e-82df-12368f4f2d59', 'volume_name': 'volume-d86d4a35-1e9b-457e-82df-12368f4f2d59', 'volume_size': 1, 'source_volid': '73604f03-40b3-444c-95eb-4427a5c200ac', 'source_volstatus': 'available'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35ea518-189d-45ea-afd2-6f6e1cbaada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35ea518-189d-45ea-afd2-6f6e1cbaada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621c332e-efb1-4cec-b708-352ff556e5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Volume d86d4a35-1e9b-457e-82df-12368f4f2d59: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d86d4a35-1e9b-457e-82df-12368f4f2d59', 'volume_size': 1, 'source_volid': '73604f03-40b3-444c-95eb-4427a5c200ac', 'source_volstatus': 'available'}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:35 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Cloning volume 73604f03-40b3-444c-95eb-4427a5c200ac to volume d86d4a35-1e9b-457e-82df-12368f4f2d59
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Creating offline snapshot a58a12bc-dda0-409f-a032-b0fb959f77e6 of volume 73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:03:35 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" returned: 0 in 0.418s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1354be-f077-4846-98ad-91956815f85e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:35 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870
Sep 16 22:03:35 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:36 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:36 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:36 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" returned: 0 in 0.311s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "cinder-quobyte-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870" released by "delete_volume" :: held 0.793s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Created reservations ['97bc8a55-e2b5-4fed-baa9-d63ceb59c840', 'de0a99dd-f2e9-4cd0-9a42-ab2f504efa58', '5e21e880-4219-497d-aac5-2a602e8e9352', '620ef2e9-d6a6-411e-a455-5e8c111ab589'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:36 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.430s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:36 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 1G
Sep 16 22:03:36 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:36 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:36 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:36 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Deleted volume successfully.
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65e62328-f5e2-4e4f-b374-855e6aa7ac4e tempest-VolumeImageDependencyTests-1803679857 None] Lock "cinder-9bacc6dc-9dd2-4d3a-8656-1a60a85aa870-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:36 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 1G" returned: 0 in 0.583s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73604f03-40b3-444c-95eb-4427a5c200ac -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:36 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73604f03-40b3-444c-95eb-4427a5c200ac -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:36 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:37 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73604f03-40b3-444c-95eb-4427a5c200ac -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.354s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:37 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 is being set with open permissions: ugo+rw
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:37 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:37 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:37 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:37 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info
Sep 16 22:03:37 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:37 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info" returned: 0 in 0.294s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:37 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info is being set with open permissions: ugo+rw
Sep 16 22:03:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:37 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info
Sep 16 22:03:37 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:38 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.info" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] snapshot: a58a12bc-dda0-409f-a032-b0fb959f77e6, volume: d86d4a35-1e9b-457e-82df-12368f4f2d59,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3474b2d-82dd-418d-a936-353782b31d71]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:38 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:38 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:38 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.425s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73604f03-40b3-444c-95eb-4427a5c200ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de811f-f4a9-48f6-bb37-f3adbdc0efcb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:38 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:38 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:39 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:03:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:03:39 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:03:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:39 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59
Sep 16 22:03:39 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Flow 'volume_create_manager' (b78b5c00-7fea-477e-8e54-22aa82c7ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d90eae-2d3b-42c1-8a4a-b4f6462102cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d90eae-2d3b-42c1-8a4a-b4f6462102cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8658dba6-3b4e-450c-9557-edb7256c4aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92bbd5a18954ea1ab36f7680e56b2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:40Z,use_quota=True,user_id='a9c8ab6c7b1b469c963b9a7a3228a705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c9a749-3a71-479a-832c-c818fe7b6a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c9a749-3a71-479a-832c-c818fe7b6a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd4af4-9e2f-4a6e-b40d-80eac5d237cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd4af4-9e2f-4a6e-b40d-80eac5d237cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8658dba6-3b4e-450c-9557-edb7256c4aa8', 'volume_name': 'volume-8658dba6-3b4e-450c-9557-edb7256c4aa8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be24fb7-75aa-4276-95bb-e6a7619aab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be24fb7-75aa-4276-95bb-e6a7619aab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca713dc-f4aa-46f1-9827-9a7c069092bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:40 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Volume 8658dba6-3b4e-450c-9557-edb7256c4aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8658dba6-3b4e-450c-9557-edb7256c4aa8', 'volume_size': 1}
Sep 16 22:03:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:46 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59" returned: 0 in 7.830s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:46 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac, size 1024.00 MB, duration 7.83 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:03:46 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Converted 1024.00 MB image at 130.77 MB/s
Sep 16 22:03:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 is being set with open permissions: ugo+rw
Sep 16 22:03:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:46 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59
Sep 16 22:03:46 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:47 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" released by "_copy_volume_from_snapshot" :: held 8.980s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-a58a12bc-dda0-409f-a032-b0fb959f77e6" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-a58a12bc-dda0-409f-a032-b0fb959f77e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Deleting offline snapshot a58a12bc-dda0-409f-a032-b0fb959f77e6 of volume 73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] snapshot_file for this snap is: volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e897f677-963e-4d78-8e84-dadde7789aee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:47 devstack sudo[101170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:47 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:47 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73604f03-40b3-444c-95eb-4427a5c200ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3641c5-55f5-4653-92b8-5f4783807ab7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:47 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:47 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:48 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.593s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:48 devstack sudo[101186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:48 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:48 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:48 devstack sudo[101192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6
Sep 16 22:03:48 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:48 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac.a58a12bc-dda0-409f-a032-b0fb959f77e6" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-a58a12bc-dda0-409f-a032-b0fb959f77e6" released by "_delete_snapshot" :: held 1.719s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.147s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.529s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8658dba6-3b4e-450c-9557-edb7256c4aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92bbd5a18954ea1ab36f7680e56b2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:40Z,use_quota=True,user_id='a9c8ab6c7b1b469c963b9a7a3228a705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Creating volume 8658dba6-3b4e-450c-9557-edb7256c4aa8 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:48 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621c332e-efb1-4cec-b708-352ff556e5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d86d4a35-1e9b-457e-82df-12368f4f2d59', 'volume_size': 1, 'source_volid': '73604f03-40b3-444c-95eb-4427a5c200ac', 'source_volstatus': 'available'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:49 devstack sudo[101195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 1073741824
Sep 16 22:03:49 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c14726-3cbf-42ec-8ef5-e9c8dbbb9cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Volume volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 (d86d4a35-1e9b-457e-82df-12368f4f2d59): created successfully
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c14726-3cbf-42ec-8ef5-e9c8dbbb9cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (816e9ffb-1167-4759-b562-91e429edd459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-56236c7b-6d43-4da8-bdf0-7e93fe9bdb57 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:03:49 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 1073741824" returned: 0 in 0.508s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:49 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8
Sep 16 22:03:49 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:49 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca713dc-f4aa-46f1-9827-9a7c069092bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8658dba6-3b4e-450c-9557-edb7256c4aa8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d336f-1986-47d6-91b1-b974e06cfe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Volume volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 (8658dba6-3b4e-450c-9557-edb7256c4aa8): created successfully
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d336f-1986-47d6-91b1-b974e06cfe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Flow 'volume_create_manager' (b78b5c00-7fea-477e-8e54-22aa82c7ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6fd59c99-52f4-405c-ba0b-e07e75111810 tempest-CinderUnicodeTest-1049203888 None] Created volume successfully.
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Flow 'volume_create_manager' (6009b0f4-d40c-4538-8fcc-7df72599eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91301cb4-26b1-4aaa-a0f6-8935af5e221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91301cb4-26b1-4aaa-a0f6-8935af5e221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-888406081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6144d374-b979-4d31-8ac7-cabbb21db3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92bbd5a18954ea1ab36f7680e56b2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:51Z,use_quota=True,user_id='a9c8ab6c7b1b469c963b9a7a3228a705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a368905-364f-4876-a061-5478545a9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a368905-364f-4876-a061-5478545a9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03762f65-185b-4760-94d0-94414cbbf05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03762f65-185b-4760-94d0-94414cbbf05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6144d374-b979-4d31-8ac7-cabbb21db3d6', 'volume_name': 'volume-6144d374-b979-4d31-8ac7-cabbb21db3d6', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b435f2-70d6-43b3-91b7-884c69748f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b435f2-70d6-43b3-91b7-884c69748f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee11640-d1aa-4de6-a64a-fc27335d81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Volume 6144d374-b979-4d31-8ac7-cabbb21db3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6144d374-b979-4d31-8ac7-cabbb21db3d6', 'volume_size': 1}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-888406081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6144d374-b979-4d31-8ac7-cabbb21db3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92bbd5a18954ea1ab36f7680e56b2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:51Z,use_quota=True,user_id='a9c8ab6c7b1b469c963b9a7a3228a705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Creating volume 6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:50 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:50 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 1073741824
Sep 16 22:03:50 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (56ec78b2-e01c-4331-ba4b-f8631a49c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a641a601-c6d4-4414-978c-e22401e81049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a641a601-c6d4-4414-978c-e22401e81049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-676577989',display_name='tempest-VolumesGetTest-Volume-745722125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e70703a-576c-4776-ace1-4cd9e39a89c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:51Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b3d885-1bcf-4f8b-8c6c-aadca1a58461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b3d885-1bcf-4f8b-8c6c-aadca1a58461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4225b9d-7f5a-4fdc-9869-708ab3ac30bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4225b9d-7f5a-4fdc-9869-708ab3ac30bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e70703a-576c-4776-ace1-4cd9e39a89c1', 'volume_name': 'volume-5e70703a-576c-4776-ace1-4cd9e39a89c1', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51bdb-d2b1-4a97-8ad8-1c6d67b7faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51bdb-d2b1-4a97-8ad8-1c6d67b7faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60356f55-723e-46ec-9786-a45f4f2aaaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Volume 5e70703a-576c-4776-ace1-4cd9e39a89c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e70703a-576c-4776-ace1-4cd9e39a89c1', 'volume_size': 1}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:51 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 1073741824" returned: 0 in 0.515s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:51 devstack sudo[101209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6
Sep 16 22:03:51 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:51 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-676577989',display_name='tempest-VolumesGetTest-Volume-745722125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e70703a-576c-4776-ace1-4cd9e39a89c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:51Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Creating volume 5e70703a-576c-4776-ace1-4cd9e39a89c1 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:03:51 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:51 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 1073741824
Sep 16 22:03:51 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee11640-d1aa-4de6-a64a-fc27335d81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6144d374-b979-4d31-8ac7-cabbb21db3d6', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96f883-ae0f-45cf-8ec4-25feb5a13e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Volume volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 (6144d374-b979-4d31-8ac7-cabbb21db3d6): created successfully
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96f883-ae0f-45cf-8ec4-25feb5a13e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Flow 'volume_create_manager' (6009b0f4-d40c-4538-8fcc-7df72599eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-eaa85acd-5383-437b-8272-ede7af3d8aae tempest-CinderUnicodeTest-1049203888 None] Created volume successfully.
Sep 16 22:03:52 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 1073741824" returned: 0 in 0.467s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:52 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1
Sep 16 22:03:52 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:52 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60356f55-723e-46ec-9786-a45f4f2aaaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e70703a-576c-4776-ace1-4cd9e39a89c1', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5ca807-0fa5-4b8e-b24c-87dba5182fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Volume volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 (5e70703a-576c-4776-ace1-4cd9e39a89c1): created successfully
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5ca807-0fa5-4b8e-b24c-87dba5182fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (56ec78b2-e01c-4331-ba4b-f8631a49c597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b596b50e-97a4-427a-88f4-1e898fdb08c6 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Creating offline snapshot 15ec41f1-73a6-444d-ab8d-78718b50b24d of volume 6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b0567-f9de-4227-84ca-41d74ca771b0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:53 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6
Sep 16 22:03:53 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-5e70703a-576c-4776-ace1-4cd9e39a89c1-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "cinder-5e70703a-576c-4776-ace1-4cd9e39a89c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-5e70703a-576c-4776-ace1-4cd9e39a89c1" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-5e70703a-576c-4776-ace1-4cd9e39a89c1" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[787357b7-e221-4f78-ba03-961ba4d603c6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:53 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6" returned: 0 in 0.522s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:53 devstack sudo[101228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d 1G
Sep 16 22:03:53 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1
Sep 16 22:03:53 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:53 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:53 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1" returned: 0 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:53 devstack sudo[101237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1
Sep 16 22:03:53 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:53 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d 1G" returned: 0 in 0.488s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:53 devstack sudo[101241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d
Sep 16 22:03:53 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:54 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5e70703a-576c-4776-ace1-4cd9e39a89c1" returned: 0 in 0.271s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-5e70703a-576c-4776-ace1-4cd9e39a89c1" released by "delete_volume" :: held 0.717s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Created reservations ['a14bccd9-d443-46da-bef4-39a971fbb82b', '44fea28c-f09e-4215-b6da-71b3274958d5', 'fbe76b84-2e98-494b-9bf5-e7bc25afc54d', 'f0cf56b9-80d8-43a0-9bf1-0b049c1622f1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:54 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:54 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:54 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d" returned: 0 in 0.360s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:54 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d is being set with open permissions: ugo+rw
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:54 devstack sudo[101249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d
Sep 16 22:03:54 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:54 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c2cb519b-1194-4876-8c41-e6470eedf25e tempest-VolumesGetTest-1863225850 None] Lock "cinder-5e70703a-576c-4776-ace1-4cd9e39a89c1-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-d86d4a35-1e9b-457e-82df-12368f4f2d59-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "cinder-d86d4a35-1e9b-457e-82df-12368f4f2d59-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:54 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d" returned: 0 in 0.452s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[db984c4e-4f94-4476-8fbe-63b75fe0f574]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:54 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info
Sep 16 22:03:54 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:54 devstack sudo[101253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59
Sep 16 22:03:54 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:55 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:55 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info is being set with open permissions: ugo+rw
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:55 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info
Sep 16 22:03:55 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:55 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:55 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59
Sep 16 22:03:55 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:55 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.info" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-37886a04-1978-41f6-aca8-f97c35c91cd6 tempest-CinderUnicodeTest-1049203888 None] Create snapshot completed successfully
Sep 16 22:03:55 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d86d4a35-1e9b-457e-82df-12368f4f2d59" returned: 0 in 0.297s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-d86d4a35-1e9b-457e-82df-12368f4f2d59" released by "delete_volume" :: held 0.752s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Created reservations ['132a661f-9b0e-4cf4-8619-461afb009554', '49612691-24c9-441a-a14d-6fddc9899f91', '0b4f0ef5-9b9f-4d8a-831e-ab16b6d348b3', 'e623f314-82e2-4160-b104-21673b4abe53'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:55 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:55 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:55 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-73604f03-40b3-444c-95eb-4427a5c200ac-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "cinder-73604f03-40b3-444c-95eb-4427a5c200ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-652f5420-27f9-455f-821c-8600eb00cfe7 tempest-VolumesGetTest-1863225850 None] Lock "cinder-d86d4a35-1e9b-457e-82df-12368f4f2d59-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-73604f03-40b3-444c-95eb-4427a5c200ac" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-73604f03-40b3-444c-95eb-4427a5c200ac" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[793931eb-011d-4996-8b61-13dbacfd954d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-15ec41f1-73a6-444d-ab8d-78718b50b24d-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-15ec41f1-73a6-444d-ab8d-78718b50b24d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-quobyte-15ec41f1-73a6-444d-ab8d-78718b50b24d" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-15ec41f1-73a6-444d-ab8d-78718b50b24d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Deleting offline snapshot 15ec41f1-73a6-444d-ab8d-78718b50b24d of volume 6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] snapshot_file for this snap is: volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e93361-1e8f-4b66-b0bd-43804ac5dc32]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:56 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:56 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:56 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d
Sep 16 22:03:56 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:56 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.427s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:56 devstack sudo[101278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac
Sep 16 22:03:56 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:56 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d" returned: 0 in 0.406s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6144d374-b979-4d31-8ac7-cabbb21db3d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40048e-da21-4ef8-8646-3ddc0d35adb5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:56 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6
Sep 16 22:03:56 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:56 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-73604f03-40b3-444c-95eb-4427a5c200ac" returned: 0 in 0.316s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-73604f03-40b3-444c-95eb-4427a5c200ac" released by "delete_volume" :: held 0.825s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Created reservations ['0a025f67-bc75-4952-b59f-ec8e4d410095', '8fbbdfcd-d217-4a28-a506-5fb4178943ba', '98c2334d-0874-4fe6-aad8-84b944c7ad56', 'c54ff6c0-5f8e-4468-abe9-b66184c8292c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:56 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:56 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:57 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6" returned: 0 in 0.439s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:57 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d
Sep 16 22:03:57 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:57 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9cc333a3-802e-402a-9132-363ebf619b88 tempest-VolumesGetTest-1863225850 None] Lock "cinder-73604f03-40b3-444c-95eb-4427a5c200ac-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:57 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d" returned: 0 in 0.466s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:57 devstack sudo[101297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d
Sep 16 22:03:57 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:57 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6.15ec41f1-73a6-444d-ab8d-78718b50b24d" returned: 0 in 0.353s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-15ec41f1-73a6-444d-ab8d-78718b50b24d" released by "_delete_snapshot" :: held 1.785s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" released by "delete_snapshot" :: held 1.809s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (9ac11994-d597-4c17-a870-d19ab0004ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058449c0-9c38-4fe8-9391-3360f4d54d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058449c0-9c38-4fe8-9391-3360f4d54d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811742850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:58Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c27df-f909-47d9-8a14-20438ae597c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b65c27df-f909-47d9-8a14-20438ae597c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a587d4ef-2cf6-4d9a-9951-0377445792cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Created reservations ['055f750e-c862-478a-86ad-40a59d68a347', '2f4314f7-3b5c-42c8-995a-2d7bb52ed018', '653cf6e0-c9e4-4872-8fa9-e5f401563d6d', '0a0c0841-8ed6-4c6d-a047-8c3b84454379'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Delete snapshot completed successfully.
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-857c5353-1d42-4d45-85c7-f1b6b03927fc tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-15ec41f1-73a6-444d-ab8d-78718b50b24d-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-6144d374-b979-4d31-8ac7-cabbb21db3d6-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-6144d374-b979-4d31-8ac7-cabbb21db3d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de1b62f-9b90-4c38-9837-ed061e2d0e09]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a587d4ef-2cf6-4d9a-9951-0377445792cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7', 'volume_name': 'volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70bc0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b7efbb-a4de-4b27-a0ad-cead19d9c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:58 devstack sudo[101300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6
Sep 16 22:03:58 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b7efbb-a4de-4b27-a0ad-cead19d9c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962262ad-1132-49a2-b3df-03bb2f46441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:03:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70bc0>}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Trying to clone 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 from image b2c54ab4-3980-45cd-a037-6930dcd310de at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:03:58 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6" returned: 0 in 0.483s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:58 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6
Sep 16 22:03:58 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:03:59 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b38670-21cf-4286-aa18-ad56757807ee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:59 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD
Sep 16 22:03:59 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:59 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6144d374-b979-4d31-8ac7-cabbb21db3d6" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-6144d374-b979-4d31-8ac7-cabbb21db3d6" released by "delete_volume" :: held 0.826s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Created reservations ['3697308a-049e-4205-80ac-177d0220db31', 'a1ab23d4-3e8e-42d7-9073-50f8457b6661', '8d1e8403-1348-461a-a6cf-2bf88e001693', '8c77ab2a-6ce0-4fea-9375-5b6f19aff4ad'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:59 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:03:59 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:59 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de is fetched for user f9e6d1ffc8a440a7af3dbe80601f8e01. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-8658dba6-3b4e-450c-9557-edb7256c4aa8-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-8658dba6-3b4e-450c-9557-edb7256c4aa8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a3c722-1782-4053-b682-071d5e18edae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "cinder-quobyte-8658dba6-3b4e-450c-9557-edb7256c4aa8" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-8658dba6-3b4e-450c-9557-edb7256c4aa8" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae1afa-bece-4c8b-abc2-13c68a3f9582]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:03:59 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.345s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:03:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Deleted volume successfully.
Sep 16 22:03:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f5cc7f6a-3b1d-498e-9b35-e8c84de18db2 tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-6144d374-b979-4d31-8ac7-cabbb21db3d6-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:03:59 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD
Sep 16 22:03:59 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:03:59 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8
Sep 16 22:03:59 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:00 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811742850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:03:58Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Creating volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:00 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:00 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:00 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1073741824
Sep 16 22:04:00 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8" returned: 0 in 0.478s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:00 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8
Sep 16 22:04:00 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:00 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8658dba6-3b4e-450c-9557-edb7256c4aa8" returned: 0 in 0.332s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-quobyte-8658dba6-3b4e-450c-9557-edb7256c4aa8" released by "delete_volume" :: held 0.901s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Created reservations ['a87b95e2-027a-49db-90ae-4221ee9110a3', 'ae330ada-739e-4382-bbda-af4fa21fcced', '2b4cbcb9-10b4-44ea-9718-839e7074e707', '0c5d2ad9-3605-4348-8522-79c0577913e0'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:00 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1073741824" returned: 0 in 0.635s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:00 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:00 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:00 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7
Sep 16 22:04:00 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:01 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Deleted volume successfully.
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-73bdb84d-72a3-4564-b4ca-d0a6c05c0adb tempest-CinderUnicodeTest-1049203888 None] Lock "cinder-8658dba6-3b4e-450c-9557-edb7256c4aa8-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:01 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" returned: 0 in 0.424s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Attempting download of b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[85060665-1ca8-42b8-8606-09b6481a2a72]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:01 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21
Sep 16 22:04:01 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:01 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:01 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21
Sep 16 22:04:01 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:02 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21" returned: 1 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_cwyehg21' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe812a-56aa-41c2-b2f0-292421e80c48]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:02 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD
Sep 16 22:04:02 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:02 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] b2c54ab4-3980-45cd-a037-6930dcd310de was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:04:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:02 devstack sudo[101356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7
Sep 16 22:04:02 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:04 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" returned: 0 in 1.935s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_ca_7c92tdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:04:04 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Converted 112.00 MB image at 57.84 MB/s
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:04 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1G
Sep 16 22:04:04 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:04 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 1G" returned: 0 in 0.339s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Downloaded image b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de for user f9e6d1ffc8a440a7af3dbe80601f8e01 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Marking volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Copying metadata from image b2c54ab4-3980-45cd-a037-6930dcd310de to 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Creating volume glance metadata for volume 8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 backed by image b2c54ab4-3980-45cd-a037-6930dcd310de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962262ad-1132-49a2-b3df-03bb2f46441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd70bc0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9109d27e-c6b7-4b56-a84e-09a19d8ebb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Volume volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 (8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7): created successfully
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9109d27e-c6b7-4b56-a84e-09a19d8ebb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (9ac11994-d597-4c17-a870-d19ab0004ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ccd03de8-f9c0-419a-a15e-c31e1a9178f3 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (cb929c9f-52cb-45d4-a30f-93062d412df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475cd90-de25-48bf-b95e-25a97f02fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3475cd90-de25-48bf-b95e-25a97f02fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1679883155',display_name='tempest-VolumesGetTest-Volume-1563946740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daaee20a-50e9-4a3a-b872-8920b24288ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:06Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c9164a-1d16-408c-9af2-3f5158763925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c9164a-1d16-408c-9af2-3f5158763925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ce37b0-ac8c-4937-8cfd-736b88ba7a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ce37b0-ac8c-4937-8cfd-736b88ba7a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daaee20a-50e9-4a3a-b872-8920b24288ec', 'volume_name': 'volume-daaee20a-50e9-4a3a-b872-8920b24288ec', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65818fbd-f46d-4bb0-bc9a-cc421b5982ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65818fbd-f46d-4bb0-bc9a-cc421b5982ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54be1853-1af8-4b27-86b0-4d6e6676b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Volume daaee20a-50e9-4a3a-b872-8920b24288ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daaee20a-50e9-4a3a-b872-8920b24288ec', 'volume_size': 1}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1679883155',display_name='tempest-VolumesGetTest-Volume-1563946740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daaee20a-50e9-4a3a-b872-8920b24288ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10f9cb615e94832b8cf54bea59daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:06Z,use_quota=True,user_id='f9e6d1ffc8a440a7af3dbe80601f8e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Creating volume daaee20a-50e9-4a3a-b872-8920b24288ec {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:06 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:06 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec 1073741824
Sep 16 22:04:06 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:06 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec 1073741824" returned: 0 in 0.452s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:07 devstack sudo[101396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec
Sep 16 22:04:07 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:07 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54be1853-1af8-4b27-86b0-4d6e6676b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daaee20a-50e9-4a3a-b872-8920b24288ec', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f6755f-f6cf-4651-9ee8-2107150ea566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Volume volume-daaee20a-50e9-4a3a-b872-8920b24288ec (daaee20a-50e9-4a3a-b872-8920b24288ec): created successfully
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f6755f-f6cf-4651-9ee8-2107150ea566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Flow 'volume_create_manager' (cb929c9f-52cb-45d4-a30f-93062d412df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c5c17a8a-753c-4613-98e9-96f54600c5d3 tempest-VolumesGetTest-1863225850 None] Created volume successfully.
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-daaee20a-50e9-4a3a-b872-8920b24288ec-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "cinder-daaee20a-50e9-4a3a-b872-8920b24288ec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-daaee20a-50e9-4a3a-b872-8920b24288ec" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-daaee20a-50e9-4a3a-b872-8920b24288ec" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65fc49-6ae7-4cb4-99c9-469e7aef9ac3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:09 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec
Sep 16 22:04:09 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:09 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:09 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec
Sep 16 22:04:09 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:09 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-daaee20a-50e9-4a3a-b872-8920b24288ec" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-daaee20a-50e9-4a3a-b872-8920b24288ec" released by "delete_volume" :: held 0.752s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Created reservations ['c88e49c2-88ed-4a69-9b2d-3e826bc1341c', '03815b16-6977-4346-a160-db104c5d79c3', '56b26495-1529-4ea8-a6a6-612260ddfdee', '312e45a8-ee78-4a0b-8aa9-cfc52d50ad52'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:09 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:09 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:10 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:10 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "cinder-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c43dd16-4e23-4110-9df5-ee90e647f906 tempest-VolumesGetTest-1863225850 None] Lock "cinder-daaee20a-50e9-4a3a-b872-8920b24288ec-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Acquiring lock "cinder-quobyte-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3aa19c-2398-4ceb-83f4-2fbf3630e4ae]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:10 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7
Sep 16 22:04:10 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:10 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" returned: 0 in 0.419s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:10 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7
Sep 16 22:04:10 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:10 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" returned: 0 in 0.277s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "cinder-quobyte-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7" released by "delete_volume" :: held 0.754s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:10 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Created reservations ['2213020c-ab24-426d-b5e7-c42cebd2a510', '28d648ad-9e5f-4eb7-9b74-04bda4a3882c', 'f8ffc57e-6bf3-4a1d-b12b-f046247e9c32', 'c0656328-9356-46f5-bab5-d0bd19237b31'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:11 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:11 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:11 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Deleted volume successfully.
Sep 16 22:04:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-30ba0851-ebd8-4dbb-b99c-922df27b3475 tempest-VolumesGetTest-1863225850 None] Lock "cinder-8b9a5edf-e9cc-444d-b9f9-3e0f5204aec7-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=146,cinder:INSERT=54,cinder:UPDATE=200,cinder:DELETE=11 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=182,cinder:DELETE=22,cinder:INSERT=58,cinder:SELECT=129 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:22 devstack sudo[101508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:22 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:22 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:04:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (b6a1a29c-6112-4e80-92b2-ba3e299c2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5499b9ba-db42-4c82-aa13-2392a72dd532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5499b9ba-db42-4c82-aa13-2392a72dd532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1453791417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dbea60-4a46-48da-9e70-717103a6437c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:27Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2962b45-e564-478b-b0ab-ff260814a548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2962b45-e564-478b-b0ab-ff260814a548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389feadf-db8a-4a40-84d4-f9f02586cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389feadf-db8a-4a40-84d4-f9f02586cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15dbea60-4a46-48da-9e70-717103a6437c', 'volume_name': 'volume-15dbea60-4a46-48da-9e70-717103a6437c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed115ebf-9359-4d65-a679-1ee4aa70e7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed115ebf-9359-4d65-a679-1ee4aa70e7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2384a71a-b358-4476-a57e-9c36ed214639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Volume 15dbea60-4a46-48da-9e70-717103a6437c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15dbea60-4a46-48da-9e70-717103a6437c', 'volume_size': 1}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1453791417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dbea60-4a46-48da-9e70-717103a6437c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:27Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Creating volume 15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:27 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:27 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c 1073741824
Sep 16 22:04:27 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:27 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c 1073741824" returned: 0 in 0.402s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:27 devstack sudo[101518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c
Sep 16 22:04:27 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:27 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2384a71a-b358-4476-a57e-9c36ed214639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15dbea60-4a46-48da-9e70-717103a6437c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed83a9f9-3478-4d8c-a671-972f681a8fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:27 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Volume volume-15dbea60-4a46-48da-9e70-717103a6437c (15dbea60-4a46-48da-9e70-717103a6437c): created successfully
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed83a9f9-3478-4d8c-a671-972f681a8fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (b6a1a29c-6112-4e80-92b2-ba3e299c2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c756d350-903f-40f2-bfa5-b5de131b685d tempest-VolumesSnapshotTestJSON-1468411096 None] Created volume successfully.
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Creating offline snapshot ef3612eb-2861-446d-9c18-40a0e9bd08de of volume 15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aaf0f1-4130-43e5-b273-a3bae00161d6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:28 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c
Sep 16 22:04:28 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:28 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c" returned: 0 in 0.419s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:28 devstack sudo[101534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de 1G
Sep 16 22:04:28 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:29 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de 1G" returned: 0 in 0.502s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dbea60-4a46-48da-9e70-717103a6437c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:29 devstack sudo[101539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dbea60-4a46-48da-9e70-717103a6437c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de
Sep 16 22:04:29 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:29 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15dbea60-4a46-48da-9e70-717103a6437c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:29 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de is being set with open permissions: ugo+rw
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:29 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de
Sep 16 22:04:29 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:29 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:29 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info
Sep 16 22:04:29 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:30 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:30 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info is being set with open permissions: ugo+rw
Sep 16 22:04:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:30 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info
Sep 16 22:04:30 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:30 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.info" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:30 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9537d265-b129-4608-9753-db5a4c52795e tempest-VolumesSnapshotTestJSON-1468411096 None] Create snapshot completed successfully
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-ef3612eb-2861-446d-9c18-40a0e9bd08de-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-ef3612eb-2861-446d-9c18-40a0e9bd08de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-ef3612eb-2861-446d-9c18-40a0e9bd08de" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-ef3612eb-2861-446d-9c18-40a0e9bd08de" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Deleting offline snapshot ef3612eb-2861-446d-9c18-40a0e9bd08de of volume 15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] snapshot_file for this snap is: volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df5673-d4c9-44bf-89aa-36e423a756d6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:31 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de
Sep 16 22:04:31 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:32 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15dbea60-4a46-48da-9e70-717103a6437c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca219f-eab7-4a51-bd0b-477842d4ee1c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:32 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c
Sep 16 22:04:32 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Flow 'volume_create_manager' (9ee718a3-c589-4292-b462-79f7e816c997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7df5db-b2cf-45f2-8aa2-f3d6bb017e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7df5db-b2cf-45f2-8aa2-f3d6bb017e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-377854416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e635502-5035-4eac-9ef9-af76fa26f8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5c87dcbf254864af282567923a1bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:32Z,use_quota=True,user_id='ddfbd2488316456e9eaaadd16e175875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3c6aab-a79c-461a-a4e6-45c4267faff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3c6aab-a79c-461a-a4e6-45c4267faff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c7e627-a2bf-443b-ac24-f7d6836b3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c7e627-a2bf-443b-ac24-f7d6836b3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e635502-5035-4eac-9ef9-af76fa26f8f7', 'volume_name': 'volume-2e635502-5035-4eac-9ef9-af76fa26f8f7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d662c7-3a5c-4179-8f53-b79c0a96b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d662c7-3a5c-4179-8f53-b79c0a96b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecbd57-a3e5-4069-8b90-e60c5ae67097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:32 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Volume 2e635502-5035-4eac-9ef9-af76fa26f8f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e635502-5035-4eac-9ef9-af76fa26f8f7', 'volume_size': 1}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-377854416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e635502-5035-4eac-9ef9-af76fa26f8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5c87dcbf254864af282567923a1bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:32Z,use_quota=True,user_id='ddfbd2488316456e9eaaadd16e175875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Creating volume 2e635502-5035-4eac-9ef9-af76fa26f8f7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:32 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:32 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 1073741824
Sep 16 22:04:32 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:32 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:32 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de
Sep 16 22:04:32 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:32 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 1073741824" returned: 0 in 0.461s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:32 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:32 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de
Sep 16 22:04:32 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:32 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7
Sep 16 22:04:32 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:33 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c.ef3612eb-2861-446d-9c18-40a0e9bd08de" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:33 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7" returned: 0 in 0.257s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-ef3612eb-2861-446d-9c18-40a0e9bd08de" released by "_delete_snapshot" :: held 1.533s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" released by "delete_snapshot" :: held 1.553s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eecbd57-a3e5-4069-8b90-e60c5ae67097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e635502-5035-4eac-9ef9-af76fa26f8f7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e6db9b-d3a5-450a-af30-4d404c397a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Volume volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 (2e635502-5035-4eac-9ef9-af76fa26f8f7): created successfully
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e6db9b-d3a5-450a-af30-4d404c397a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Flow 'volume_create_manager' (9ee718a3-c589-4292-b462-79f7e816c997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3a57ed52-c404-4bec-bfc1-4342fedf69eb tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Created volume successfully.
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['d9f8c504-48c2-4d2e-a518-551ee6386212', '661f4097-b6f9-46ad-bb46-e086adda70bb', '9f2973f8-2cbb-445b-bd10-d87ccfaeb9bb', '7e5cde13-e7b5-43cb-af60-baef5d22cad3'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Delete snapshot completed successfully.
Sep 16 22:04:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5f4e490-9b3c-4501-b4d5-accc21bb89de tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-ef3612eb-2861-446d-9c18-40a0e9bd08de-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (745b37b3-6a55-4ff8-991b-1efae32759e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd25505-6fe0-47e1-88bf-76f26682c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd25505-6fe0-47e1-88bf-76f26682c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945016523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:34Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c18c5-247f-4972-abd4-09f7ff64038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c18c5-247f-4972-abd4-09f7ff64038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3ca0c4-6a49-4393-be0c-a9fcd0c80d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3ca0c4-6a49-4393-be0c-a9fcd0c80d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e', 'volume_name': 'volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3bb1c-3f7c-409c-b2a9-661fde6d37af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3bb1c-3f7c-409c-b2a9-661fde6d37af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b53bd77-0b11-41eb-bc45-92f00b05afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:34 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume 1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e', 'volume_size': 1}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945016523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:34Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating volume 1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:34 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:34 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e 1073741824
Sep 16 22:04:34 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:34 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e 1073741824" returned: 0 in 0.502s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:34 devstack sudo[101593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:34 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c7b4cba7-3ad9-4c18-b40e-e579a13793f4 req-4d4e2a88-2340-4c62-94d1-b622d4e1206a tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:35 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.245s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c7b4cba7-3ad9-4c18-b40e-e579a13793f4 req-4d4e2a88-2340-4c62-94d1-b622d4e1206a tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.029s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b53bd77-0b11-41eb-bc45-92f00b05afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31aa217-a972-4a88-be63-51771815e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-c7b4cba7-3ad9-4c18-b40e-e579a13793f4 req-4d4e2a88-2340-4c62-94d1-b622d4e1206a tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e (1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e): created successfully
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31aa217-a972-4a88-be63-51771815e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (745b37b3-6a55-4ff8-991b-1efae32759e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e4e675f4-0ca8-42eb-9543-d91b009ce3f9 tempest-VolumesSnapshotTestJSON-1468411096 None] Created volume successfully.
Sep 16 22:04:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-c7b4cba7-3ad9-4c18-b40e-e579a13793f4 req-4d4e2a88-2340-4c62-94d1-b622d4e1206a tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-2e635502-5035-4eac-9ef9-af76fa26f8f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e5df658-6835-4466-823d-fc1a38997634', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:04:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-c7b4cba7-3ad9-4c18-b40e-e579a13793f4 req-4d4e2a88-2340-4c62-94d1-b622d4e1206a tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] attachment_update completed successfully.
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Creating offline snapshot db42013f-33a5-47ca-87fe-5d7dfca0f4d7 of volume 1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a8431-71cc-4874-a181-66cdd9731493]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:36 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:36 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:36 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.367s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:36 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 1G
Sep 16 22:04:36 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:37 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 1G" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:37 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:37 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:37 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.292s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:37 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 is being set with open permissions: ugo+rw
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:37 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:37 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:37 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:37 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info
Sep 16 22:04:37 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:38 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info" returned: 0 in 0.273s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:38 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info is being set with open permissions: ugo+rw
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-f200f2e2-1428-4a47-a044-3e8c7cb0b952 req-9152e8a0-f5aa-431c-b92a-9367bf06a81b tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Terminate volume connection completed successfully.
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-f200f2e2-1428-4a47-a044-3e8c7cb0b952 req-9152e8a0-f5aa-431c-b92a-9367bf06a81b tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Deleting attachment 4e5df658-6835-4466-823d-fc1a38997634. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:04:38 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info
Sep 16 22:04:38 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:38 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.info" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2d550c5a-06f5-4b79-8fb0-acdff77ff56e tempest-VolumesSnapshotTestJSON-1468411096 None] Create snapshot completed successfully
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "cinder-2e635502-5035-4eac-9ef9-af76fa26f8f7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "cinder-2e635502-5035-4eac-9ef9-af76fa26f8f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "cinder-quobyte-2e635502-5035-4eac-9ef9-af76fa26f8f7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "cinder-quobyte-2e635502-5035-4eac-9ef9-af76fa26f8f7" acquired by "delete_volume" :: waited 0.028s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4708c-6f80-4ec6-91a2-cee0262b29e5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (8b091565-1a05-4b15-bcfa-bca1533b6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24b985d-1215-44db-8c21-dbc6bbb21a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24b985d-1215-44db-8c21-dbc6bbb21a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1502820239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1e664e-82fd-4805-80d3-7d07f9319680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=db42013f-33a5-47ca-87fe-5d7dfca0f4d7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:39Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d0f702-96b1-48b2-8bdb-574a8ed65f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d0f702-96b1-48b2-8bdb-574a8ed65f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1ac17-d0df-4691-a141-32b440ce202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1ac17-d0df-4691-a141-32b440ce202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb1e664e-82fd-4805-80d3-7d07f9319680', 'volume_name': 'volume-eb1e664e-82fd-4805-80d3-7d07f9319680', 'volume_size': 2, 'snapshot_id': 'db42013f-33a5-47ca-87fe-5d7dfca0f4d7'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8e755c-09b6-4c49-b6eb-a58d146599f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8e755c-09b6-4c49-b6eb-a58d146599f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbfbb69-daa8-48d5-9e69-a7b336a9fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:39 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume eb1e664e-82fd-4805-80d3-7d07f9319680: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb1e664e-82fd-4805-80d3-7d07f9319680', 'volume_size': 2, 'snapshot_id': 'db42013f-33a5-47ca-87fe-5d7dfca0f4d7'}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-eb1e664e-82fd-4805-80d3-7d07f9319680" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:39 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-eb1e664e-82fd-4805-80d3-7d07f9319680" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating volume eb1e664e-82fd-4805-80d3-7d07f9319680 from snapshot db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:39 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] snapshot: db42013f-33a5-47ca-87fe-5d7dfca0f4d7, volume: eb1e664e-82fd-4805-80d3-7d07f9319680,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a8568-9703-43d9-91b1-36bec7ed72ee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:39 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:39 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:39 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:39 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7
Sep 16 22:04:39 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:39 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8eee8-516b-406b-b087-8cf184cb54f9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:39 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e635502-5035-4eac-9ef9-af76fa26f8f7" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "cinder-quobyte-2e635502-5035-4eac-9ef9-af76fa26f8f7" released by "delete_volume" :: held 0.671s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:39 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:39 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Created reservations ['6f8190c9-0fcd-4bdc-8ef6-1d9298f0d456', '0c1bed79-ecf1-4ed7-8a92-3b3b7f614bc1', '53bff982-c23b-4cbd-a8e8-cfd38096fae6', 'deafe112-1b91-4311-9ef7-0ca567a7bfb8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:39 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:39 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:40 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.388s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:40 devstack sudo[102088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680
Sep 16 22:04:40 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:40 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Deleted volume successfully.
Sep 16 22:04:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d8553ab-dd0c-4229-9fd2-784c05d8276f tempest-TestServerVolumeAttachScenarioOldVersion-1264391821 None] Lock "cinder-2e635502-5035-4eac-9ef9-af76fa26f8f7-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:47 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680" returned: 0 in 7.549s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:04:47 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Converted 1024.00 MB image at 135.62 MB/s
Sep 16 22:04:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 is being set with open permissions: ugo+rw
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:47 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680
Sep 16 22:04:47 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:47 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" released by "_copy_volume_from_snapshot" :: held 8.643s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-eb1e664e-82fd-4805-80d3-7d07f9319680" released by "_create_volume_from_snapshot" :: held 8.711s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.726s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbfbb69-daa8-48d5-9e69-a7b336a9fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1e664e-82fd-4805-80d3-7d07f9319680', 'volume_size': 2, 'snapshot_id': 'db42013f-33a5-47ca-87fe-5d7dfca0f4d7'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8c209c-0ef4-4862-bf8f-831c6b9b3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:47 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume volume-eb1e664e-82fd-4805-80d3-7d07f9319680 (eb1e664e-82fd-4805-80d3-7d07f9319680): created successfully
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8c209c-0ef4-4862-bf8f-831c6b9b3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:47 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (8b091565-1a05-4b15-bcfa-bca1533b6272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-81873395-1c57-45ec-9c4a-7dc0b2f212d9 tempest-VolumesSnapshotTestJSON-1468411096 None] Created volume successfully.
Sep 16 22:04:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-eb1e664e-82fd-4805-80d3-7d07f9319680-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-eb1e664e-82fd-4805-80d3-7d07f9319680-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[69624bb5-2165-49dc-a76e-4ecd56b86774]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:49 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680
Sep 16 22:04:49 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:49 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680" returned: 0 in 0.355s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:49 devstack sudo[102179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680
Sep 16 22:04:49 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:49 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-eb1e664e-82fd-4805-80d3-7d07f9319680" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-eb1e664e-82fd-4805-80d3-7d07f9319680" released by "delete_volume" :: held 0.658s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['b13cbb34-392b-4f84-8ff8-7be810cabd76', 'be7245f5-caa1-4ac9-81a7-fc9f3442c9ea', 'd3082e62-bd28-42ce-bff1-6af257b4c428', '6eb43471-0879-4de3-8087-31635dd869a8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:49 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:49 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:50 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Deleted volume successfully.
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e7f67cee-d2c0-4585-a3cb-c10cf4cae54d tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-eb1e664e-82fd-4805-80d3-7d07f9319680-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Deleting offline snapshot db42013f-33a5-47ca-87fe-5d7dfca0f4d7 of volume 1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] snapshot_file for this snap is: volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de29a3-3a02-4629-acaf-6bfcacd9fdaf]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:50 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:50 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:50 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.412s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f83b1-a5cc-47db-bd1f-0aef718acb39]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:50 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:50 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:51 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.534s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:51 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:51 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:51 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:51 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7
Sep 16 22:04:51 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:51 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e.db42013f-33a5-47ca-87fe-5d7dfca0f4d7" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-db42013f-33a5-47ca-87fe-5d7dfca0f4d7" released by "_delete_snapshot" :: held 1.672s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" released by "delete_snapshot" :: held 1.694s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:51 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['9c3b8d20-75d4-4564-a45a-2d368f8fd6b0', '4f3a1f36-0af9-4fb8-8f43-2fe2c9e3550b', '9fcf36ca-a25d-4e89-be6c-489780253ecb', '85ef4373-bbb8-4255-a10e-648afa5c2f60'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Delete snapshot completed successfully.
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-10cf78c9-c7dd-4177-bb9f-21a63ec2d7e3 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-db42013f-33a5-47ca-87fe-5d7dfca0f4d7-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c6c672-f2d2-403e-aba5-6c79639388c1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:52 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:52 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:52 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:52 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e
Sep 16 22:04:52 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:53 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e" released by "delete_volume" :: held 0.697s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['0224d616-504f-4586-b625-bb144b251760', 'f9af9780-ad16-4d5f-ab55-5f90bfeafd1b', '70026598-eaf7-4cbd-84a9-f93b1e728c1a', '6117d400-df10-4c92-9c61-4608f8418bd8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:53 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:04:53 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:53 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:04:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Deleted volume successfully.
Sep 16 22:04:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-60521869-dbee-440a-9d38-ce513f7af2d0 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-1b7e5dbd-1ff5-4356-8f81-39d1ebcb2b4e-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (c8a42e4d-903f-4965-80f6-cea1553f379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3102ec0-f134-4f37-a4bc-a1c0dc750ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3102ec0-f134-4f37-a4bc-a1c0dc750ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2127363079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ce4d7d-588f-4de7-ae09-5650eef3f17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:54Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2391869-d8d3-499e-9136-e53adf7ac357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2391869-d8d3-499e-9136-e53adf7ac357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85643541-8071-4e0a-945e-66156611d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85643541-8071-4e0a-945e-66156611d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ce4d7d-588f-4de7-ae09-5650eef3f17c', 'volume_name': 'volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213e72a4-83b6-4673-88f2-5719deab19f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213e72a4-83b6-4673-88f2-5719deab19f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a049465c-fff3-4163-bd4c-7db3104d6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:54 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume 01ce4d7d-588f-4de7-ae09-5650eef3f17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c', 'volume_size': 1}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2127363079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ce4d7d-588f-4de7-ae09-5650eef3f17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:54Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating volume 01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:54 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:54 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c 1073741824
Sep 16 22:04:54 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:54 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c 1073741824" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:54 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:04:54 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:54 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.242s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:04:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a049465c-fff3-4163-bd4c-7db3104d6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5545687c-e917-419d-b3cf-42ac16434035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:55 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c (01ce4d7d-588f-4de7-ae09-5650eef3f17c): created successfully
Sep 16 22:04:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5545687c-e917-419d-b3cf-42ac16434035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:55 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (c8a42e4d-903f-4965-80f6-cea1553f379a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e9029a3c-32e8-4c72-b111-a800e49b9c90 tempest-VolumesSnapshotTestJSON-1468411096 None] Created volume successfully.
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating offline snapshot 5b64a501-8c02-400c-b3be-9382dc74bad7 of volume 01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278685f-1df1-4f19-a4e7-fad71ac16f24]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:56 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:04:56 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:56 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:56 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 1G
Sep 16 22:04:56 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:57 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 1G" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:57 devstack sudo[102239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:04:57 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:57 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:57 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 is being set with open permissions: ugo+rw
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:57 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:04:57 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:57 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:57 devstack sudo[102247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info
Sep 16 22:04:57 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:58 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:58 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info is being set with open permissions: ugo+rw
Sep 16 22:04:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:58 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info
Sep 16 22:04:58 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:58 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.info" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a7d7c2d3-82d8-498a-b9ae-68b49303b241 tempest-VolumesSnapshotTestJSON-1468411096 None] Create snapshot completed successfully
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (d7c8bfbd-3db1-434c-bcfd-19e65131b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f9f4e7-d045-460f-b531-151c81402ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f9f4e7-d045-460f-b531-151c81402ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-806825971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b3e79-f1e6-40cc-9178-c10fe4408147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e763eb7bf0d949a29ae2031a3e631963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b64a501-8c02-400c-b3be-9382dc74bad7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:04:59Z,use_quota=True,user_id='958a3be67a87416b8f4f93e0a5950ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3b93e9-561a-4adb-a1dc-47d512c34c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3b93e9-561a-4adb-a1dc-47d512c34c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73185d1-4f0c-4d9b-9469-bccae1cfa49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73185d1-4f0c-4d9b-9469-bccae1cfa49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a9b3e79-f1e6-40cc-9178-c10fe4408147', 'volume_name': 'volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147', 'volume_size': 1, 'snapshot_id': '5b64a501-8c02-400c-b3be-9382dc74bad7'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052a957d-e04e-438d-9e9a-9054da2d7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052a957d-e04e-438d-9e9a-9054da2d7328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be108b4c-d10c-4b96-a1d5-fea847d7cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:04:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume 4a9b3e79-f1e6-40cc-9178-c10fe4408147: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147', 'volume_size': 1, 'snapshot_id': '5b64a501-8c02-400c-b3be-9382dc74bad7'}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7-4a9b3e79-f1e6-40cc-9178-c10fe4408147" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7-4a9b3e79-f1e6-40cc-9178-c10fe4408147" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating volume 4a9b3e79-f1e6-40cc-9178-c10fe4408147 from snapshot 5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] snapshot: 5b64a501-8c02-400c-b3be-9382dc74bad7, volume: 4a9b3e79-f1e6-40cc-9178-c10fe4408147,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4954f2ab-de54-483c-91f1-6f2e77509494]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:59 devstack sudo[102253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:04:59 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:59 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e12118-353a-46ab-a76d-2297fa7bf469]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:04:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:04:59 devstack sudo[102259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:04:59 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:04:59 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:05:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:05:00 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:05:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:00 devstack sudo[102264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147
Sep 16 22:05:00 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:07 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147" returned: 0 in 7.226s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:05:07 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Converted 1024.00 MB image at 141.68 MB/s
Sep 16 22:05:07 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 is being set with open permissions: ugo+rw
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:07 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147
Sep 16 22:05:07 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:07 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" released by "_copy_volume_from_snapshot" :: held 8.330s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7-4a9b3e79-f1e6-40cc-9178-c10fe4408147" released by "_create_volume_from_snapshot" :: held 8.396s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.410s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be108b4c-d10c-4b96-a1d5-fea847d7cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147', 'volume_size': 1, 'snapshot_id': '5b64a501-8c02-400c-b3be-9382dc74bad7'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f365842a-b183-4ff9-af56-4554aa1c44fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Volume volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 (4a9b3e79-f1e6-40cc-9178-c10fe4408147): created successfully
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f365842a-b183-4ff9-af56-4554aa1c44fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Flow 'volume_create_manager' (d7c8bfbd-3db1-434c-bcfd-19e65131b61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:05:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7c7e4b18-26e1-4397-95ef-e156dd7c23c2 tempest-VolumesSnapshotTestJSON-1468411096 None] Created volume successfully.
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-4a9b3e79-f1e6-40cc-9178-c10fe4408147-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-4a9b3e79-f1e6-40cc-9178-c10fe4408147-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3e8ad-0879-44a7-9e64-423f8aab1f3b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:08 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147
Sep 16 22:05:08 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:08 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:08 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147
Sep 16 22:05:08 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:08 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a9b3e79-f1e6-40cc-9178-c10fe4408147" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-4a9b3e79-f1e6-40cc-9178-c10fe4408147" released by "delete_volume" :: held 0.682s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['cc94310a-8c1b-4f3b-a4b3-3d2190060924', '175ef2c4-52ab-4ece-b9b3-d73a3e8948b6', 'f478109c-7210-4ab2-af68-90c19a51b718', '3e7fbe48-a9ee-4c95-a4af-852c132c18e9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:08 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:05:08 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:09 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:05:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Deleted volume successfully.
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-80a1dac6-53c4-4600-a40d-5fde03dd1343 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-4a9b3e79-f1e6-40cc-9178-c10fe4408147-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-5b64a501-8c02-400c-b3be-9382dc74bad7-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-5b64a501-8c02-400c-b3be-9382dc74bad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Deleting offline snapshot 5b64a501-8c02-400c-b3be-9382dc74bad7 of volume 01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] snapshot_file for this snap is: volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96afee-4534-4bf2-8585-c1d71555d81c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:09 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:05:09 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:09 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa736c-ffdc-4260-9ee8-b097157ca8f9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:09 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:05:09 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:10 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.552s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:10 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:05:10 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:10 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.362s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:10 devstack sudo[102311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7
Sep 16 22:05:10 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:10 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c.5b64a501-8c02-400c-b3be-9382dc74bad7" returned: 0 in 0.270s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-5b64a501-8c02-400c-b3be-9382dc74bad7" released by "_delete_snapshot" :: held 1.760s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" released by "delete_snapshot" :: held 1.782s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['19487c3d-4fab-4967-8938-73dff7bae645', '3f2c89c9-28de-4065-b587-c5fa374a9099', '311dfb0d-d5d2-475a-9407-d39e6e6e7cc1', 'a57aff26-8def-42f6-9460-f04e94cb324e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:05:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Delete snapshot completed successfully.
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-57f78e62-8e2d-436e-a422-419fc2fc94df tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-5b64a501-8c02-400c-b3be-9382dc74bad7-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-01ce4d7d-588f-4de7-ae09-5650eef3f17c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-01ce4d7d-588f-4de7-ae09-5650eef3f17c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e44844-1b27-41b8-984c-1a6e8d061846]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:11 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:05:11 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:11 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:11 devstack sudo[102319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c
Sep 16 22:05:11 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:12 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01ce4d7d-588f-4de7-ae09-5650eef3f17c" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-01ce4d7d-588f-4de7-ae09-5650eef3f17c" released by "delete_volume" :: held 0.755s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['0b66684b-57a3-4897-8763-7b3fcda9df67', 'cc53bcc7-36fd-4a18-a8d3-558627ead0aa', '762aee47-47db-4957-9dad-57a74a6cf391', '33b63aee-41b9-4c68-8cfd-26ecdeff00e7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:12 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:05:12 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:12 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-15dbea60-4a46-48da-9e70-717103a6437c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:05:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Deleted volume successfully.
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-15dbea60-4a46-48da-9e70-717103a6437c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c31f5480-cb4b-4f8a-9f67-29dff76c59a2 tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-01ce4d7d-588f-4de7-ae09-5650eef3f17c-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e5c38a-87d3-4646-a462-2dcf63e4fd19]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:12 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c
Sep 16 22:05:12 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:13 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:13 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c
Sep 16 22:05:13 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:13 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-15dbea60-4a46-48da-9e70-717103a6437c" returned: 0 in 0.257s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-quobyte-15dbea60-4a46-48da-9e70-717103a6437c" released by "delete_volume" :: held 0.688s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Created reservations ['d7780159-aa06-4aaa-bc97-0a329033935c', '892bd6b4-11d3-48fa-960e-797c6aca66fc', '377aea82-138d-416c-a5c2-fee23d405bbd', 'a69fadf4-48d1-4090-a445-0485b3795d7f'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:13 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:05:13 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:13 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:05:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Deleted volume successfully.
Sep 16 22:05:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4a5d5c54-442a-48dc-a15d-61b662f9460e tempest-VolumesSnapshotTestJSON-1468411096 None] Lock "cinder-15dbea60-4a46-48da-9e70-717103a6437c-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:05:21 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:22 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:05:22 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:22 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.283s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:05:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=86,cinder:UPDATE=86,cinder:INSERT=26,cinder:DELETE=7 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=94,cinder:SELECT=87,cinder:DELETE=8,cinder:INSERT=19 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Flow 'volume_create_manager' (29c7eb06-af75-4fd2-abd7-f8eb1d30aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f07aa8-d2d4-45a4-824c-8e6d74fc7c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f07aa8-d2d4-45a4-824c-8e6d74fc7c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1117019551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2429364-e053-4d75-99a5-0faa4a6409da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac81882f5448e48b157562f426e185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:05:25Z,use_quota=True,user_id='433e5a81e158448d82f827fbb2fb7804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dec9a8-92bc-4c61-9e4a-238301f90a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dec9a8-92bc-4c61-9e4a-238301f90a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6576db9-a1e6-4034-8c73-94e6361565f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6576db9-a1e6-4034-8c73-94e6361565f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2429364-e053-4d75-99a5-0faa4a6409da', 'volume_name': 'volume-c2429364-e053-4d75-99a5-0faa4a6409da', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb36e9e-2fc7-44db-9d4f-0fc3e75dc3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb36e9e-2fc7-44db-9d4f-0fc3e75dc3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3993ca-67a4-422e-82cf-10fe6bf1f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Volume c2429364-e053-4d75-99a5-0faa4a6409da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2429364-e053-4d75-99a5-0faa4a6409da', 'volume_size': 1}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1117019551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2429364-e053-4d75-99a5-0faa4a6409da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac81882f5448e48b157562f426e185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:05:25Z,use_quota=True,user_id='433e5a81e158448d82f827fbb2fb7804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Creating volume c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:05:24 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:05:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:24 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da 1073741824
Sep 16 22:05:24 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:25 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da 1073741824" returned: 0 in 0.495s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:25 devstack sudo[102355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:05:25 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:25 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3993ca-67a4-422e-82cf-10fe6bf1f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2429364-e053-4d75-99a5-0faa4a6409da', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab18f7dd-2a3e-40f7-bfc2-7e2600666c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Volume volume-c2429364-e053-4d75-99a5-0faa4a6409da (c2429364-e053-4d75-99a5-0faa4a6409da): created successfully
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab18f7dd-2a3e-40f7-bfc2-7e2600666c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Flow 'volume_create_manager' (29c7eb06-af75-4fd2-abd7-f8eb1d30aa30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:05:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-019dd2f0-481e-418e-84c4-13c59fc3a561 tempest-TestStampPattern-1453765060 None] Created volume successfully.
Sep 16 22:05:35 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:05:35 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Flow 'volume_create_manager' (8b9b1a6d-d78c-40c7-b71a-4a68f661ba20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3941f196-0d4d-412d-bc6c-73d9faf37a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3941f196-0d4d-412d-bc6c-73d9faf37a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1562445193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184cf505-bfac-44fd-b06b-2464500eb9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a363066d5344418b41d78a81ad299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:05:46Z,use_quota=True,user_id='92dcf014bbca4ff08bc0847eb7f35bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4855296b-2d78-4163-a398-c2f8744c6902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4855296b-2d78-4163-a398-c2f8744c6902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee7b75-4d44-49f7-b2f1-e95232308cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee7b75-4d44-49f7-b2f1-e95232308cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '184cf505-bfac-44fd-b06b-2464500eb9cf', 'volume_name': 'volume-184cf505-bfac-44fd-b06b-2464500eb9cf', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5a75cd0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff4a88b-39fa-49f0-a22d-c9f3808238bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff4a88b-39fa-49f0-a22d-c9f3808238bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d18d0-4a96-4e6a-9001-cde08e4e024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:46 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Volume 184cf505-bfac-44fd-b06b-2464500eb9cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-184cf505-bfac-44fd-b06b-2464500eb9cf', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5a75cd0>}
Sep 16 22:05:46 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Trying to clone 184cf505-bfac-44fd-b06b-2464500eb9cf from image b2c54ab4-3980-45cd-a037-6930dcd310de at location (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:05:47 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba5a03-f773-4b78-9741-5a44e95bfebd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:47 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD
Sep 16 22:05:47 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:47 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de is fetched for user 92dcf014bbca4ff08bc0847eb7f35bf3. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046e748-4e9e-4956-892a-0032f91f1835]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:47 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD
Sep 16 22:05:47 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:47 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1562445193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184cf505-bfac-44fd-b06b-2464500eb9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a363066d5344418b41d78a81ad299ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:05:46Z,use_quota=True,user_id='92dcf014bbca4ff08bc0847eb7f35bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Creating volume 184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:05:47 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:05:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:47 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1073741824
Sep 16 22:05:47 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:48 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1073741824" returned: 0 in 0.413s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:48 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf
Sep 16 22:05:48 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:48 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Attempting download of b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 184cf505-bfac-44fd-b06b-2464500eb9cf. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[76710748-23f0-406d-847a-1dc215aa6b7c]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:48 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc
Sep 16 22:05:48 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:48 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:49 devstack sudo[102542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc
Sep 16 22:05:49 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:49 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc" returned: 1 in 0.310s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b2c54ab4-3980-45cd-a037-6930dcd310de_i6bah4fc' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13686a-466a-489f-95c5-c8edf1ba806f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:49 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD
Sep 16 22:05:49 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:49 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] b2c54ab4-3980-45cd-a037-6930dcd310de was qcow2, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:05:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:49 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf
Sep 16 22:05:49 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:51 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf" returned: 0 in 1.819s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b2c54ab4-3980-45cd-a037-6930dcd310de_nhid69i6devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:05:51 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Converted 112.00 MB image at 61.51 MB/s
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:05:51 devstack sudo[102560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1G
Sep 16 22:05:51 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:05:51 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf 1G" returned: 0 in 0.328s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Downloaded image b2c54ab4-3980-45cd-a037-6930dcd310de ((None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}])) to volume 184cf505-bfac-44fd-b06b-2464500eb9cf successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Temporary image b2c54ab4-3980-45cd-a037-6930dcd310de for user 92dcf014bbca4ff08bc0847eb7f35bf3 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Marking volume 184cf505-bfac-44fd-b06b-2464500eb9cf as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Copying metadata from image b2c54ab4-3980-45cd-a037-6930dcd310de to 184cf505-bfac-44fd-b06b-2464500eb9cf. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Creating volume glance metadata for volume 184cf505-bfac-44fd-b06b-2464500eb9cf backed by image b2c54ab4-3980-45cd-a037-6930dcd310de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208d18d0-4a96-4e6a-9001-cde08e4e024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184cf505-bfac-44fd-b06b-2464500eb9cf', 'volume_size': 1, 'image_id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b2c54ab4-3980-45cd-a037-6930dcd310de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6c3226e23a2046d78f939bccd40f5438', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b2c54ab4-3980-45cd-a037-6930dcd310de', 'created_at': datetime.datetime(2026, 9, 16, 19, 44, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 19, 44, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b2c54ab4-3980-45cd-a037-6930dcd310de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82a5a75cd0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3935a-67a1-488b-88cd-38e0dd5224f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:05:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Volume volume-184cf505-bfac-44fd-b06b-2464500eb9cf (184cf505-bfac-44fd-b06b-2464500eb9cf): created successfully
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3935a-67a1-488b-88cd-38e0dd5224f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:05:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Flow 'volume_create_manager' (8b9b1a6d-d78c-40c7-b71a-4a68f661ba20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:05:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5304b738-cdde-4a90-91bf-45561003162c tempest-TestShelveInstance-990646212 None] Created volume successfully.
Sep 16 22:05:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa756718-2539-4ab4-b29e-5a1a48ecebf6 req-5367f47d-6c11-47d2-a434-5139dad495bb tempest-TestShelveInstance-990646212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa756718-2539-4ab4-b29e-5a1a48ecebf6 req-5367f47d-6c11-47d2-a434-5139dad495bb tempest-TestShelveInstance-990646212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-fa756718-2539-4ab4-b29e-5a1a48ecebf6 req-5367f47d-6c11-47d2-a434-5139dad495bb tempest-TestShelveInstance-990646212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:54 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-fa756718-2539-4ab4-b29e-5a1a48ecebf6 req-5367f47d-6c11-47d2-a434-5139dad495bb tempest-TestShelveInstance-990646212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-184cf505-bfac-44fd-b06b-2464500eb9cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '922edc85-2b9a-464d-ae6d-75be7eac3631', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:05:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-fa756718-2539-4ab4-b29e-5a1a48ecebf6 req-5367f47d-6c11-47d2-a434-5139dad495bb tempest-TestShelveInstance-990646212 None] attachment_update completed successfully.
Sep 16 22:05:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-62424e09-4882-4fbb-8e0f-e69fb74b9b98 req-584f59a3-015e-4c4b-91d2-681bba83c33d tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:05:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-62424e09-4882-4fbb-8e0f-e69fb74b9b98 req-584f59a3-015e-4c4b-91d2-681bba83c33d tempest-TestStampPattern-1453765060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:05:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-62424e09-4882-4fbb-8e0f-e69fb74b9b98 req-584f59a3-015e-4c4b-91d2-681bba83c33d tempest-TestStampPattern-1453765060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:05:56 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-62424e09-4882-4fbb-8e0f-e69fb74b9b98 req-584f59a3-015e-4c4b-91d2-681bba83c33d tempest-TestStampPattern-1453765060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-c2429364-e053-4d75-99a5-0faa4a6409da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db5223cc-385e-497e-83c5-b340acb0e5be', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:05:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-62424e09-4882-4fbb-8e0f-e69fb74b9b98 req-584f59a3-015e-4c4b-91d2-681bba83c33d tempest-TestStampPattern-1453765060 None] attachment_update completed successfully.
Sep 16 22:06:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-f4564671-1b79-4419-a95e-788d5dd27873 req-70458dcd-82a6-4e53-94e5-acab203c1e76 tempest-TestStampPattern-1453765060 None] Terminate volume connection completed successfully.
Sep 16 22:06:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-f4564671-1b79-4419-a95e-788d5dd27873 req-70458dcd-82a6-4e53-94e5-acab203c1e76 tempest-TestStampPattern-1453765060 None] Deleting attachment db5223cc-385e-497e-83c5-b340acb0e5be. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Creating offline snapshot 6acccbb5-fbb6-415e-822b-42bbc6f12f3e of volume c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb0bd3-83af-4da3-b9e5-2204294172e7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:03 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:06:03 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:03 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.427s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:03 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e 1G
Sep 16 22:06:03 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:04 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e 1G" returned: 0 in 0.411s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2429364-e053-4d75-99a5-0faa4a6409da -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:04 devstack sudo[103114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2429364-e053-4d75-99a5-0faa4a6409da -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:04 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:04 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2429364-e053-4d75-99a5-0faa4a6409da -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:04 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e is being set with open permissions: ugo+rw
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:04 devstack sudo[103119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:04 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:04 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.236s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:04 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info
Sep 16 22:06:04 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:04 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info" returned: 0 in 0.241s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:04 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info is being set with open permissions: ugo+rw
Sep 16 22:06:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:04 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info
Sep 16 22:06:04 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:05 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.info" returned: 0 in 0.237s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d49005fd-28d2-448d-bf9f-2bfda9c2c476 tempest-TestStampPattern-1453765060 None] Create snapshot completed successfully
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Flow 'volume_create_manager' (f718db11-f451-4f56-9f51-eee619d238e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9059e60-4255-4960-aa1a-c67cd65acb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9059e60-4255-4960-aa1a-c67cd65acb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1089191872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e9773c-00ee-4f6d-a089-e7ea7b10fae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eac81882f5448e48b157562f426e185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6acccbb5-fbb6-415e-822b-42bbc6f12f3e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:06:12Z,use_quota=True,user_id='433e5a81e158448d82f827fbb2fb7804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13accf0-a53f-4cc3-83e5-cc270cebbdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13accf0-a53f-4cc3-83e5-cc270cebbdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b1b0d-19a5-4409-9dbf-61ca08c13133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b1b0d-19a5-4409-9dbf-61ca08c13133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61e9773c-00ee-4f6d-a089-e7ea7b10fae9', 'volume_name': 'volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9', 'volume_size': 1, 'snapshot_id': '6acccbb5-fbb6-415e-822b-42bbc6f12f3e'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde3591d-2650-45f1-9118-5d2735b71f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde3591d-2650-45f1-9118-5d2735b71f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73952378-834b-4709-a229-7249d819ccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Volume 61e9773c-00ee-4f6d-a089-e7ea7b10fae9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9', 'volume_size': 1, 'snapshot_id': '6acccbb5-fbb6-415e-822b-42bbc6f12f3e'}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Creating volume 61e9773c-00ee-4f6d-a089-e7ea7b10fae9 from snapshot 6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] snapshot: 6acccbb5-fbb6-415e-822b-42bbc6f12f3e, volume: 61e9773c-00ee-4f6d-a089-e7ea7b10fae9,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec569cbc-72de-46a4-bd47-9bc4b01e2327]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:12 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:12 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:12 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.372s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2429364-e053-4d75-99a5-0faa4a6409da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0171e-a228-4abb-8378-6fe843c75dbb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:12 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:06:12 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:13 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.449s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:06:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:06:13 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:06:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:13 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9
Sep 16 22:06:13 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=11,cinder:SELECT=29,cinder:INSERT=10 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:06:22 devstack sudo[103282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:06:22 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=29,cinder:UPDATE=8,cinder:INSERT=5,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" returned: 0 in 9.333s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:06:22 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Converted 1024.00 MB image at 109.71 MB/s
Sep 16 22:06:22 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 is being set with open permissions: ugo+rw
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:22 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.433s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:06:22 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9
Sep 16 22:06:22 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:22 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" returned: 0 in 0.317s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" released by "_copy_volume_from_snapshot" :: held 10.568s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" released by "_create_volume_from_snapshot" :: held 10.674s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.693s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73952378-834b-4709-a229-7249d819ccb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9', 'volume_size': 1, 'snapshot_id': '6acccbb5-fbb6-415e-822b-42bbc6f12f3e'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f60c4ab-c340-4e55-81b1-99bb9b8d3104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:06:22 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Volume volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 (61e9773c-00ee-4f6d-a089-e7ea7b10fae9): created successfully
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f60c4ab-c340-4e55-81b1-99bb9b8d3104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:06:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Flow 'volume_create_manager' (f718db11-f451-4f56-9f51-eee619d238e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:06:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dd9db410-7ce2-46e3-a9c4-94b45949c5b1 tempest-TestStampPattern-1453765060 None] Created volume successfully.
Sep 16 22:06:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-abb7f5fd-24f4-4d79-a4fa-853e467de982 req-99fd9d12-6770-4656-be21-d16dc77c54c4 tempest-TestShelveInstance-990646212 None] Terminate volume connection completed successfully.
Sep 16 22:06:27 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-abb7f5fd-24f4-4d79-a4fa-853e467de982 req-99fd9d12-6770-4656-be21-d16dc77c54c4 tempest-TestShelveInstance-990646212 None] Deleting attachment 922edc85-2b9a-464d-ae6d-75be7eac3631. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:06:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-14387013-5d2c-49f6-846e-eaef3bde9e44 req-084208c2-657b-48da-814e-12cf65f0769e tempest-TestShelveInstance-990646212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-14387013-5d2c-49f6-846e-eaef3bde9e44 req-084208c2-657b-48da-814e-12cf65f0769e tempest-TestShelveInstance-990646212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-14387013-5d2c-49f6-846e-eaef3bde9e44 req-084208c2-657b-48da-814e-12cf65f0769e tempest-TestShelveInstance-990646212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:31 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-14387013-5d2c-49f6-846e-eaef3bde9e44 req-084208c2-657b-48da-814e-12cf65f0769e tempest-TestShelveInstance-990646212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-184cf505-bfac-44fd-b06b-2464500eb9cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa3dbfad-62b1-400d-844a-c2e911b31a57', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:06:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-14387013-5d2c-49f6-846e-eaef3bde9e44 req-084208c2-657b-48da-814e-12cf65f0769e tempest-TestShelveInstance-990646212 None] attachment_update completed successfully.
Sep 16 22:06:41 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:DELETE=1 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:06:41 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:06:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-634882d7-6247-4457-87bb-edee67123c7d req-34bb699a-2b19-4d04-844c-8c578cfffd0f tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-634882d7-6247-4457-87bb-edee67123c7d req-34bb699a-2b19-4d04-844c-8c578cfffd0f tempest-TestStampPattern-1453765060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-634882d7-6247-4457-87bb-edee67123c7d req-34bb699a-2b19-4d04-844c-8c578cfffd0f tempest-TestStampPattern-1453765060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-634882d7-6247-4457-87bb-edee67123c7d req-34bb699a-2b19-4d04-844c-8c578cfffd0f tempest-TestStampPattern-1453765060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c', 'name': 'volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0042be9-4891-46cd-a6f8-db556ac6f361', 'enforce_multipath': True} {{(pid=85936) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 22:06:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-634882d7-6247-4457-87bb-edee67123c7d req-34bb699a-2b19-4d04-844c-8c578cfffd0f tempest-TestStampPattern-1453765060 None] attachment_update completed successfully.
Sep 16 22:06:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-8cbc1551-8fc1-42e8-a1e1-344111d2593a req-9ddac54c-6176-42e1-90d3-94d0e89fe83f tempest-TestStampPattern-1453765060 None] Terminate volume connection completed successfully.
Sep 16 22:06:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-8cbc1551-8fc1-42e8-a1e1-344111d2593a req-9ddac54c-6176-42e1-90d3-94d0e89fe83f tempest-TestStampPattern-1453765060 None] Deleting attachment f0042be9-4891-46cd-a6f8-db556ac6f361. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-61e9773c-00ee-4f6d-a089-e7ea7b10fae9-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "cinder-61e9773c-00ee-4f6d-a089-e7ea7b10fae9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101a2f8-ae0b-4fa3-9954-9f731f7ef8f8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:56 devstack sudo[103989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9
Sep 16 22:06:56 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:56 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" returned: 0 in 0.388s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:56 devstack sudo[103994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9
Sep 16 22:06:56 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:57 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-61e9773c-00ee-4f6d-a089-e7ea7b10fae9" released by "delete_volume" :: held 0.684s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Created reservations ['2c5278ec-1847-47e5-b942-c28aaec54023', 'ad5d1215-1670-4693-a420-064fd1a3b93d', 'b41a8425-60c9-45ca-bf49-311359c22fc9', '809c41b8-14e4-4b03-9349-c6091c92acbe'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:57 devstack sudo[103997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:06:57 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:57 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:06:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Deleted volume successfully.
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-519cf244-9fe4-4933-a667-c4c567ff0b33 tempest-TestStampPattern-1453765060 None] Lock "cinder-61e9773c-00ee-4f6d-a089-e7ea7b10fae9-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Deleting offline snapshot 6acccbb5-fbb6-415e-822b-42bbc6f12f3e of volume c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] snapshot_file for this snap is: volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67ce288-6714-4063-b42d-a2b93eb72992]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:57 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:57 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:58 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.353s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2429364-e053-4d75-99a5-0faa4a6409da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb9d011-090f-49f5-82c4-bc5f32c85ac1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:58 devstack sudo[104005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:06:58 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:58 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.509s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:58 devstack sudo[104010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:58 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:59 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.334s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:06:59 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e
Sep 16 22:06:59 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:06:59 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da.6acccbb5-fbb6-415e-822b-42bbc6f12f3e" returned: 0 in 0.245s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-6acccbb5-fbb6-415e-822b-42bbc6f12f3e" released by "_delete_snapshot" :: held 1.536s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" released by "delete_snapshot" :: held 1.558s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Created reservations ['4a24ac7f-0aa8-4b7a-987d-72c00f41d8a1', 'fa4d2df2-6da3-45c1-9ccd-12f048c1bb17', 'f737c269-b355-4857-959f-7510993a7b81', '026ab1a1-5f58-4c83-87a1-deaf3ab66bad'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:06:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Delete snapshot completed successfully.
Sep 16 22:06:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c3dbae38-3d0f-4419-bbde-a85a1d16ba46 tempest-TestStampPattern-1453765060 None] Lock "cinder-6acccbb5-fbb6-415e-822b-42bbc6f12f3e-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-c2429364-e053-4d75-99a5-0faa4a6409da-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "cinder-c2429364-e053-4d75-99a5-0faa4a6409da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Acquiring lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc70e879-7f46-4ee0-9c32-d24f3ad73e3d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:03 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:07:03 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:03 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:03 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da
Sep 16 22:07:03 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:04 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c2429364-e053-4d75-99a5-0faa4a6409da" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "cinder-quobyte-c2429364-e053-4d75-99a5-0faa4a6409da" released by "delete_volume" :: held 0.672s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Created reservations ['ef6c00fb-56f8-45f5-8ba6-a0e6f3fc79c4', '3d9b71ff-544a-4323-a740-5215a37c66b0', '60e38b07-2c72-4877-8155-f2413a4bac63', 'a12e47a9-be7d-4eb8-8e74-1da38004f690'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:04 devstack sudo[104055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:04 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:04 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Deleted volume successfully.
Sep 16 22:07:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-20c68611-2bfe-4f5d-ba90-28aab2a54be2 tempest-TestStampPattern-1453765060 None] Lock "cinder-c2429364-e053-4d75-99a5-0faa4a6409da-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:14 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=21 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:07:14 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:07:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-2d4cb792-187b-49ff-84d8-0943aceb4925 tempest-TestShelveInstance-990646212 None] Terminate volume connection completed successfully.
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-2d4cb792-187b-49ff-84d8-0943aceb4925 tempest-TestShelveInstance-990646212 None] Deleting attachment aa3dbfad-62b1-400d-844a-c2e911b31a57. {{(pid=85936) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Acquiring lock "cinder-184cf505-bfac-44fd-b06b-2464500eb9cf-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "cinder-184cf505-bfac-44fd-b06b-2464500eb9cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Acquiring lock "cinder-quobyte-184cf505-bfac-44fd-b06b-2464500eb9cf" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "cinder-quobyte-184cf505-bfac-44fd-b06b-2464500eb9cf" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d419178f-62e0-46e7-b19c-a0e9e6eb469d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:15 devstack sudo[104093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf
Sep 16 22:07:15 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:16 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf" returned: 0 in 0.419s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:16 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf
Sep 16 22:07:16 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:16 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-184cf505-bfac-44fd-b06b-2464500eb9cf" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "cinder-quobyte-184cf505-bfac-44fd-b06b-2464500eb9cf" released by "delete_volume" :: held 0.742s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.quota [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Created reservations ['f041de48-5782-436f-be43-d10b487392cd', '29502e16-fe49-4570-9c9b-abcb2f88653d', '25790ce0-5720-4a33-b33d-8c3c86b03ca0', '1dcaeaeb-0ba9-405b-8b70-48853d433d3a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (0f8f1ce9-cc28-47df-81d7-2b8a8337ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97611f59-26ef-4abc-9c16-df0623f8b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97611f59-26ef-4abc-9c16-df0623f8b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323503733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de4aab-717c-4d0f-8fc6-eaeaa28a231a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:16Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ad5d20-4e0d-4f13-a9f4-5563cfb1e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ad5d20-4e0d-4f13-a9f4-5563cfb1e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843703a0-afee-4a85-85e8-4314a1dcf24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843703a0-afee-4a85-85e8-4314a1dcf24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04de4aab-717c-4d0f-8fc6-eaeaa28a231a', 'volume_name': 'volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2f38f8-1dc0-4d87-a519-a7f14b2411f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2f38f8-1dc0-4d87-a519-a7f14b2411f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73351b1-f881-430e-89dd-d3ca587b33fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume 04de4aab-717c-4d0f-8fc6-eaeaa28a231a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a', 'volume_size': 1}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-323503733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04de4aab-717c-4d0f-8fc6-eaeaa28a231a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:16Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume 04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:16 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:16 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a 1073741824
Sep 16 22:07:16 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:16 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:16 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:16 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:16 devstack cinder-volume[85936]: DEBUG cinder.manager [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Deleted volume successfully.
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [req-19a9dc4e-ee1d-48e6-a949-dac42da317c7 req-05b16c52-edf4-467b-b1aa-e67aafd23ecc tempest-TestShelveInstance-990646212 None] Lock "cinder-184cf505-bfac-44fd-b06b-2464500eb9cf-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:17 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a 1073741824" returned: 0 in 0.506s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:17 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a
Sep 16 22:07:17 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:17 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73351b1-f881-430e-89dd-d3ca587b33fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69702eb-be35-4c1d-a07b-e6899ae24480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:17 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a (04de4aab-717c-4d0f-8fc6-eaeaa28a231a): created successfully
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69702eb-be35-4c1d-a07b-e6899ae24480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (0f8f1ce9-cc28-47df-81d7-2b8a8337ad89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:17 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-80536446-2470-4dfc-b24c-f3304b908507 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating offline snapshot 1f353297-4825-4289-9beb-b7f8e204be56 of volume 04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:07:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb56c9-b3b7-4a90-89cc-c17e131943b7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:18 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a
Sep 16 22:07:18 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:19 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:19 devstack sudo[104122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 1G
Sep 16 22:07:19 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:19 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 1G" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:19 devstack sudo[104128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56
Sep 16 22:07:19 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:19 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56" returned: 0 in 0.282s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:19 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 is being set with open permissions: ugo+rw
Sep 16 22:07:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:19 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56
Sep 16 22:07:19 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:20 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:20 devstack sudo[104138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info
Sep 16 22:07:20 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:20 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:20 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info is being set with open permissions: ugo+rw
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:20 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info
Sep 16 22:07:20 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:20 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.info" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-aaefcf99-c95a-4722-addb-2c8112ea2f2d tempest-CreateVolumesFromSnapshotTest-1361443386 None] Create snapshot completed successfully
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:22 devstack sudo[104145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:22 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:22 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (4feb7d54-3ea4-425b-90d2-facbbd6b863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39554062-d45a-48fe-8d57-91f6aae390de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39554062-d45a-48fe-8d57-91f6aae390de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747212681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e667aa-fc90-440e-9f68-4df3a337c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:22Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d908eae-7e76-492c-85d5-80f15a4b92f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d908eae-7e76-492c-85d5-80f15a4b92f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a0a004-17f6-4389-9e3a-c6849db9e4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a0a004-17f6-4389-9e3a-c6849db9e4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e667aa-fc90-440e-9f68-4df3a337c39b', 'volume_name': 'volume-14e667aa-fc90-440e-9f68-4df3a337c39b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fbfa68-f4e7-4711-aefa-8c68b3d8eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2fbfa68-f4e7-4711-aefa-8c68b3d8eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734a680-bb02-4490-8802-83c3d7eb5b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume 14e667aa-fc90-440e-9f68-4df3a337c39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e667aa-fc90-440e-9f68-4df3a337c39b', 'volume_size': 1}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747212681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e667aa-fc90-440e-9f68-4df3a337c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:22Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume 14e667aa-fc90-440e-9f68-4df3a337c39b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:22 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:22 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b 1073741824
Sep 16 22:07:22 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (b51e39af-93db-436a-983d-563755d317cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f1738-52cd-4e38-9ec0-009981bba43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f1738-52cd-4e38-9ec0-009981bba43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1764183730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:23Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dda0cb-cf45-4667-b7c7-824cfcbd07b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dda0cb-cf45-4667-b7c7-824cfcbd07b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471c2384-bc75-47c2-be53-b044a0ae7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471c2384-bc75-47c2-be53-b044a0ae7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8', 'volume_name': 'volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ed557-fbf0-42a9-abf7-4f656dd8e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ed557-fbf0-42a9-abf7-4f656dd8e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180f388d-0efe-42db-8806-e17f1ccaac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:22 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8', 'volume_size': 1}
Sep 16 22:07:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:23 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b 1073741824" returned: 0 in 0.626s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:23 devstack sudo[104156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b
Sep 16 22:07:23 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (b0536231-37c1-4b5a-940a-5773ca437a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49e1b18-0879-48a2-98e3-233588bc7abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49e1b18-0879-48a2-98e3-233588bc7abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967710032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a0fa1c-4609-498b-8bfb-cd5a4de40692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:23Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f0912-eb91-4431-8bf7-8fa2cabd66a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8f0912-eb91-4431-8bf7-8fa2cabd66a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e65ef83-7b29-42cb-94e9-ebe9a78f541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e65ef83-7b29-42cb-94e9-ebe9a78f541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a0fa1c-4609-498b-8bfb-cd5a4de40692', 'volume_name': 'volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3cb5db-4351-4193-b629-d2df0745fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3cb5db-4351-4193-b629-d2df0745fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f52ce5-d6ba-4ef9-a69f-6754a2d6845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume 28a0fa1c-4609-498b-8bfb-cd5a4de40692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692', 'volume_size': 1}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:23 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1764183730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:23Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:23 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734a680-bb02-4490-8802-83c3d7eb5b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e667aa-fc90-440e-9f68-4df3a337c39b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 1073741824
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed2cae1-3907-466c-9b11-753293ffc7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:23 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-14e667aa-fc90-440e-9f68-4df3a337c39b (14e667aa-fc90-440e-9f68-4df3a337c39b): created successfully
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed2cae1-3907-466c-9b11-753293ffc7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (4feb7d54-3ea4-425b-90d2-facbbd6b863d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-095aa8c9-fc6d-40b3-b238-7114209de9d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (058830c2-e7a9-46cb-9413-594b65d9a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31721e0-7458-4885-b963-a4cabfde0282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31721e0-7458-4885-b963-a4cabfde0282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797872581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cc00fa-946a-4bfb-8131-53699af4412d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:24Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dd5393-a127-4202-a1f9-2fba670c25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dd5393-a127-4202-a1f9-2fba670c25ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d53cf8-dc8b-479a-8d82-5732a78b8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d53cf8-dc8b-479a-8d82-5732a78b8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64cc00fa-946a-4bfb-8131-53699af4412d', 'volume_name': 'volume-64cc00fa-946a-4bfb-8131-53699af4412d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63688467-2a3f-442f-a235-61b33563a327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63688467-2a3f-442f-a235-61b33563a327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a399bb-cda7-45bd-9667-393c43194775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:23 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume 64cc00fa-946a-4bfb-8131-53699af4412d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64cc00fa-946a-4bfb-8131-53699af4412d', 'volume_size': 1}
Sep 16 22:07:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:24 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (bf465929-70aa-4ec6-bd27-5ac5e08af1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce93c0-3346-4afc-aff7-efdcfc132143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 1073741824" returned: 0 in 0.630s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ce93c0-3346-4afc-aff7-efdcfc132143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367298986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0921e1d-2451-4908-9bbc-1713b75ce8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:24Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8c00ba-1842-43b8-911a-334025d9963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8c00ba-1842-43b8-911a-334025d9963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a33799-4d69-46e4-a556-ecbbff4efaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a33799-4d69-46e4-a556-ecbbff4efaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0921e1d-2451-4908-9bbc-1713b75ce8ff', 'volume_name': 'volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98eb2bbf-4f96-42a5-8d86-bddc64d41451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98eb2bbf-4f96-42a5-8d86-bddc64d41451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe9c4a3-08b2-494d-b246-7bfd98f5e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume c0921e1d-2451-4908-9bbc-1713b75ce8ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff', 'volume_size': 1}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:24 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8
Sep 16 22:07:24 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:24 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967710032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a0fa1c-4609-498b-8bfb-cd5a4de40692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:23Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume 28a0fa1c-4609-498b-8bfb-cd5a4de40692 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:24 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180f388d-0efe-42db-8806-e17f1ccaac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 1073741824
Sep 16 22:07:24 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318f074-0ff8-4f57-8122-b50819a461b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 (f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8): created successfully
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a318f074-0ff8-4f57-8122-b50819a461b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (b51e39af-93db-436a-983d-563755d317cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bc395e63-d1a9-491b-b462-ef484f42a493 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:25 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 1073741824" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:25 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692
Sep 16 22:07:25 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:25 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1797872581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64cc00fa-946a-4bfb-8131-53699af4412d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:24Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume 64cc00fa-946a-4bfb-8131-53699af4412d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:25 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f52ce5-d6ba-4ef9-a69f-6754a2d6845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:25 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d 1073741824
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be136048-06e1-461b-8d0e-e8dd579528e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:25 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 (28a0fa1c-4609-498b-8bfb-cd5a4de40692): created successfully
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be136048-06e1-461b-8d0e-e8dd579528e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (b0536231-37c1-4b5a-940a-5773ca437a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4de10015-e5e5-44c7-bf0a-0fcefcdb28d3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:25 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d 1073741824" returned: 0 in 0.505s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:25 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d
Sep 16 22:07:25 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:26 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1367298986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0921e1d-2451-4908-9bbc-1713b75ce8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509a5ea6270d4c8b918dcda362c98d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:24Z,use_quota=True,user_id='de9286cbab1e48ad8ea7580867fc5972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Creating volume c0921e1d-2451-4908-9bbc-1713b75ce8ff {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:26 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a399bb-cda7-45bd-9667-393c43194775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cc00fa-946a-4bfb-8131-53699af4412d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb00b3b6-ed6c-4d43-af6e-60cb14f37932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:26 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff 1073741824
Sep 16 22:07:26 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-64cc00fa-946a-4bfb-8131-53699af4412d (64cc00fa-946a-4bfb-8131-53699af4412d): created successfully
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb00b3b6-ed6c-4d43-af6e-60cb14f37932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (058830c2-e7a9-46cb-9413-594b65d9a859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-eb81932b-302c-42e6-8219-b00d93182855 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:26 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff 1073741824" returned: 0 in 0.498s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:26 devstack sudo[104192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff
Sep 16 22:07:26 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:26 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff" returned: 0 in 0.275s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe9c4a3-08b2-494d-b246-7bfd98f5e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2d0ca6-9e5d-4551-8542-a2261e3d1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Volume volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff (c0921e1d-2451-4908-9bbc-1713b75ce8ff): created successfully
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2d0ca6-9e5d-4551-8542-a2261e3d1be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Flow 'volume_create_manager' (bf465929-70aa-4ec6-bd27-5ac5e08af1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f67c406b-b1b6-4fb5-816e-0836d32aa60b tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created volume successfully.
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-c0921e1d-2451-4908-9bbc-1713b75ce8ff-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-c0921e1d-2451-4908-9bbc-1713b75ce8ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-c0921e1d-2451-4908-9bbc-1713b75ce8ff" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-c0921e1d-2451-4908-9bbc-1713b75ce8ff" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a1e3f-ae57-475a-80dd-5113fbce9887]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:27 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff
Sep 16 22:07:27 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:28 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:28 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff
Sep 16 22:07:28 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:28 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c0921e1d-2451-4908-9bbc-1713b75ce8ff" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-c0921e1d-2451-4908-9bbc-1713b75ce8ff" released by "delete_volume" :: held 0.678s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['f0b556ea-84e5-461c-97b4-a7f9f0f1b92c', '96d92ad1-057c-4266-b54e-1f368407677e', 'abe328e8-2228-4f95-b73a-fe3712586dde', '7d719153-82e2-4d23-a6d7-19f4b39ee0ea'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:28 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:28 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:28 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4d835764-e0fd-40fd-9874-f222c43fa834 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-c0921e1d-2451-4908-9bbc-1713b75ce8ff-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-64cc00fa-946a-4bfb-8131-53699af4412d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-64cc00fa-946a-4bfb-8131-53699af4412d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-64cc00fa-946a-4bfb-8131-53699af4412d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-64cc00fa-946a-4bfb-8131-53699af4412d" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb6cd3-e78e-41a2-84b1-56e7017074a3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:28 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d
Sep 16 22:07:28 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:29 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:29 devstack sudo[104211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d
Sep 16 22:07:29 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:29 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-64cc00fa-946a-4bfb-8131-53699af4412d" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-64cc00fa-946a-4bfb-8131-53699af4412d" released by "delete_volume" :: held 0.692s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['bb510d8e-f582-4bfc-abc2-e6642f50cc6d', '9a9022c3-d6cd-41d2-8dac-624ce054ce44', 'ce744aa2-2710-44b7-9595-2e9d09e5c0d8', 'e54964eb-6538-4d0d-adc2-0a67e0c3040d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:29 devstack sudo[104214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:29 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:29 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.267s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-28a0fa1c-4609-498b-8bfb-cd5a4de40692-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-28a0fa1c-4609-498b-8bfb-cd5a4de40692-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be761d9c-77ed-4128-bebd-ba17bda2d6a7 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-64cc00fa-946a-4bfb-8131-53699af4412d-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-28a0fa1c-4609-498b-8bfb-cd5a4de40692" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-28a0fa1c-4609-498b-8bfb-cd5a4de40692" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04cecf-7722-4946-98a7-a5cb75fe2c23]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:30 devstack sudo[104217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692
Sep 16 22:07:30 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:30 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:30 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692
Sep 16 22:07:30 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:30 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-28a0fa1c-4609-498b-8bfb-cd5a4de40692" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-28a0fa1c-4609-498b-8bfb-cd5a4de40692" released by "delete_volume" :: held 0.684s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['7572f5ec-1fca-4019-a3ba-732ec048c873', '2d3dce23-cb23-428b-8cc9-82973f0c0ab7', '339f2934-1c57-452a-b9e0-1845e2542c6c', '6296d046-4832-4577-a748-2724ff822544'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:30 devstack sudo[104225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:30 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:31 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e34e717-e55d-4e18-aacf-5d95c0e018b3 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-28a0fa1c-4609-498b-8bfb-cd5a4de40692-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43792cd-ed86-4b5e-852f-84d80b2c4a2f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:31 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8
Sep 16 22:07:31 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:31 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" returned: 0 in 0.395s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:31 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8
Sep 16 22:07:31 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:31 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8" released by "delete_volume" :: held 0.699s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:31 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['cc61d81c-3acb-4876-94f5-e782c5e716d3', '5cc181a4-17dd-4051-8bd2-34709d9de039', '36da0c2f-c582-453d-8abb-1b7e9a71e0d4', 'ea992f95-d83c-43e6-92ee-a06518d33048'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:32 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:32 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-14e667aa-fc90-440e-9f68-4df3a337c39b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:32 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-14e667aa-fc90-440e-9f68-4df3a337c39b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-321b2b63-5fc0-4377-9ebb-e4477637f393 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-f2e96adb-9cd6-4a36-aaa3-7e7fdcd921f8-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-14e667aa-fc90-440e-9f68-4df3a337c39b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-14e667aa-fc90-440e-9f68-4df3a337c39b" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[42badf41-fe45-47e2-8fff-e516f9dc5502]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:32 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b
Sep 16 22:07:32 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Flow 'volume_create_manager' (b9d3d0e5-a87f-4cdf-b94f-a0614e4bf843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:32 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f51e47-cf47-4d93-9c71-774f060d7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b" returned: 0 in 0.421s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f51e47-cf47-4d93-9c71-774f060d7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979590be-a2bc-4f54-93fc-975d0667b143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7827474f0a42528e5a496569aafeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:33Z,use_quota=True,user_id='e9740d3a6be646c6bf4d056354faa233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a7b2445-73f6-4cdd-a9c3-9a73bad94678),volume_type_id=2a7b2445-73f6-4cdd-a9c3-9a73bad94678)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:32 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b
Sep 16 22:07:32 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a068f0c0-358a-42ce-a56e-10f9fdf221f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a068f0c0-358a-42ce-a56e-10f9fdf221f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3953be6b-b228-4b16-8a09-1c9db36457e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:32 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:07:33 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-14e667aa-fc90-440e-9f68-4df3a337c39b" returned: 0 in 0.253s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3953be6b-b228-4b16-8a09-1c9db36457e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '979590be-a2bc-4f54-93fc-975d0667b143', 'volume_name': 'volume-979590be-a2bc-4f54-93fc-975d0667b143', 'volume_size': 1, 'image_id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2884f64c9544f9040b6aea9f29f99864', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7827474f0a42528e5a496569aafeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d62f4bd65771efeff9de9527b92d8bec8e8b977cd5296d7c2d784464dcf540f7a18fc73a7ba60954dd6675b6881dfe4b6e089232ce3068ba113a6baacc1de9c', 'id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'created_at': datetime.datetime(2026, 9, 16, 20, 7, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee4da73c-8738-4255-a974-8fe7e7c15152/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82b03a78c0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b291f992-5628-4c36-8eaa-6c2012d6b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b291f992-5628-4c36-8eaa-6c2012d6b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c3daf3-a717-40f0-bc81-f6e48bc4df01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:33 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Volume 979590be-a2bc-4f54-93fc-975d0667b143: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-979590be-a2bc-4f54-93fc-975d0667b143', 'volume_size': 1, 'image_id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2884f64c9544f9040b6aea9f29f99864', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7827474f0a42528e5a496569aafeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d62f4bd65771efeff9de9527b92d8bec8e8b977cd5296d7c2d784464dcf540f7a18fc73a7ba60954dd6675b6881dfe4b6e089232ce3068ba113a6baacc1de9c', 'id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'created_at': datetime.datetime(2026, 9, 16, 20, 7, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee4da73c-8738-4255-a974-8fe7e7c15152/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82b03a78c0>}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Trying to clone 979590be-a2bc-4f54-93fc-975d0667b143 from image ee4da73c-8738-4255-a974-8fe7e7c15152 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-14e667aa-fc90-440e-9f68-4df3a337c39b" released by "delete_volume" :: held 0.751s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['ff165a93-966b-4475-a7e8-e23161c9ab9b', 'cf7feac7-6a67-4108-86e6-c3de653b8982', 'e5a51699-ee95-4e76-8780-5f0d09ee774f', '87e62203-8094-45d7-81e9-aba69366e13b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:07:33 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a74473-f92e-4df2-9d2b-2161bee9ff16]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:33 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:33 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:33 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:33 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-1f353297-4825-4289-9beb-b7f8e204be56-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:33 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-1f353297-4825-4289-9beb-b7f8e204be56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-1f353297-4825-4289-9beb-b7f8e204be56" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a056e338-1005-431e-98f2-07af3c8ed8ff tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-14e667aa-fc90-440e-9f68-4df3a337c39b-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-1f353297-4825-4289-9beb-b7f8e204be56" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleting offline snapshot 1f353297-4825-4289-9beb-b7f8e204be56 of volume 04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] snapshot_file for this snap is: volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f82b3d-36ca-4e6e-9620-06664b0f129d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:33 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:33 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56
Sep 16 22:07:33 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:33 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:33 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:33 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:07:33 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Temporary image ee4da73c-8738-4255-a974-8fe7e7c15152 is fetched for user e9740d3a6be646c6bf4d056354faa233. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:07:34 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3812914-09cc-40e7-8962-b11c85c3c1b9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc5faf3-0c41-4044-8b3c-7f223d5cfdbe]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a
Sep 16 22:07:34 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:34 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" returned: 0 in 0.365s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56
Sep 16 22:07:34 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:34 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56" returned: 0 in 0.322s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56
Sep 16 22:07:34 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979590be-a2bc-4f54-93fc-975d0667b143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe7827474f0a42528e5a496569aafeb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:33Z,use_quota=True,user_id='e9740d3a6be646c6bf4d056354faa233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a7b2445-73f6-4cdd-a9c3-9a73bad94678),volume_type_id=2a7b2445-73f6-4cdd-a9c3-9a73bad94678)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Creating volume 979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:34 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:34 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1073741824
Sep 16 22:07:34 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:34 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a.1f353297-4825-4289-9beb-b7f8e204be56" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-1f353297-4825-4289-9beb-b7f8e204be56" released by "_delete_snapshot" :: held 1.431s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" released by "delete_snapshot" :: held 1.464s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['d54ae99d-9baa-4abc-bd41-6781c142c664', '7aaba573-9ba4-47e3-998d-af289294931c', '24b2b4f2-f2c0-4841-9f02-baa33523d01b', '0c0cbdec-de1c-4589-b1f2-0d32ed7c339e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:35 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Delete snapshot completed successfully.
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-6e82e3c2-b86a-4b67-8a2f-396088d9a139 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-1f353297-4825-4289-9beb-b7f8e204be56-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:35 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1073741824" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:35 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143
Sep 16 22:07:35 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:35 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143" returned: 0 in 0.232s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Attempting download of ee4da73c-8738-4255-a974-8fe7e7c15152 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}])) to volume 979590be-a2bc-4f54-93fc-975d0667b143. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553ad04-cee5-445f-bbfc-9cb65821e913]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-04de4aab-717c-4d0f-8fc6-eaeaa28a231a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:35 devstack sudo[104298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97
Sep 16 22:07:35 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-04de4aab-717c-4d0f-8fc6-eaeaa28a231a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ab451-b4c7-45e4-9fe9-f6193137b340]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:35 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97" returned: 0 in 0.353s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:35 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a
Sep 16 22:07:35 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97
Sep 16 22:07:36 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" returned: 0 in 0.394s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:36 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a
Sep 16 22:07:36 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97" returned: 1 in 0.339s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee4da73c-8738-4255-a974-8fe7e7c15152_uehf3w97' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdaaa49-3e78-4060-8cf6-3f8c932ea608]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:36 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:36 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-quobyte-04de4aab-717c-4d0f-8fc6-eaeaa28a231a" released by "delete_volume" :: held 0.721s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Created reservations ['c5b88d8c-fc15-471d-86c5-e5b43c0b8df1', '439c35a7-6d9d-4f81-9e8c-7391b3958ada', 'cb1d26ea-303f-43ff-8265-9df8c2cd9a7b', '01cdc54e-b36c-48c5-b93e-096560d9cc11'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:36 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:36 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:36 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD
Sep 16 22:07:36 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:36 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Deleted volume successfully.
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c7ecae8c-d472-461c-9db0-95ab8777db78 tempest-CreateVolumesFromSnapshotTest-1361443386 None] Lock "cinder-04de4aab-717c-4d0f-8fc6-eaeaa28a231a-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:36 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] ee4da73c-8738-4255-a974-8fe7e7c15152 was raw, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:07:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:37 devstack sudo[104326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143
Sep 16 22:07:37 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:37 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143" returned: 0 in 0.451s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee4da73c-8738-4255-a974-8fe7e7c15152_b41211mgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:07:37 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:37 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1G
Sep 16 22:07:37 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:37 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 1G" returned: 0 in 0.345s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Downloaded image ee4da73c-8738-4255-a974-8fe7e7c15152 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}])) to volume 979590be-a2bc-4f54-93fc-975d0667b143 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Temporary image ee4da73c-8738-4255-a974-8fe7e7c15152 for user e9740d3a6be646c6bf4d056354faa233 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Marking volume 979590be-a2bc-4f54-93fc-975d0667b143 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Copying metadata from image ee4da73c-8738-4255-a974-8fe7e7c15152 to 979590be-a2bc-4f54-93fc-975d0667b143. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Creating volume glance metadata for volume 979590be-a2bc-4f54-93fc-975d0667b143 backed by image ee4da73c-8738-4255-a974-8fe7e7c15152 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2884f64c9544f9040b6aea9f29f99864', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c3daf3-a717-40f0-bc81-f6e48bc4df01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979590be-a2bc-4f54-93fc-975d0667b143', 'volume_size': 1, 'image_id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee4da73c-8738-4255-a974-8fe7e7c15152', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2884f64c9544f9040b6aea9f29f99864', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe7827474f0a42528e5a496569aafeb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d62f4bd65771efeff9de9527b92d8bec8e8b977cd5296d7c2d784464dcf540f7a18fc73a7ba60954dd6675b6881dfe4b6e089232ce3068ba113a6baacc1de9c', 'id': 'ee4da73c-8738-4255-a974-8fe7e7c15152', 'created_at': datetime.datetime(2026, 9, 16, 20, 7, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 7, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee4da73c-8738-4255-a974-8fe7e7c15152/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82b03a78c0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d64e8eb-692f-4c66-949c-4c916513caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Volume volume-979590be-a2bc-4f54-93fc-975d0667b143 (979590be-a2bc-4f54-93fc-975d0667b143): created successfully
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d64e8eb-692f-4c66-949c-4c916513caa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Flow 'volume_create_manager' (b9d3d0e5-a87f-4cdf-b94f-a0614e4bf843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0aee18fd-dfcc-4a98-a152-1db0aa5567f3 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Created volume successfully.
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Acquiring lock "cinder-979590be-a2bc-4f54-93fc-975d0667b143-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "cinder-979590be-a2bc-4f54-93fc-975d0667b143-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Acquiring lock "cinder-quobyte-979590be-a2bc-4f54-93fc-975d0667b143" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "cinder-quobyte-979590be-a2bc-4f54-93fc-975d0667b143" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea39a76-30fb-430f-bda2-e44fc9ef4f23]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:38 devstack sudo[104337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143
Sep 16 22:07:38 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:38 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:38 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143
Sep 16 22:07:38 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:38 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-979590be-a2bc-4f54-93fc-975d0667b143" returned: 0 in 0.281s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "cinder-quobyte-979590be-a2bc-4f54-93fc-975d0667b143" released by "delete_volume" :: held 0.705s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:38 devstack cinder-volume[85936]: WARNING cinder.quota [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 22:07:38 devstack cinder-volume[85936]: WARNING cinder.quota [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Created reservations ['5d3e37fa-f78d-4867-9097-e11b33b7f0ea', '7af20ad5-94ed-4f1d-95c2-97027a1f4e3a', '80e4ffc4-daa2-4559-93d9-cdb275c5c8fd', '5ba2c0b9-a0f0-4f56-916d-c58796c2e20c'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:39 devstack sudo[104345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:39 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:39 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Deleted volume successfully.
Sep 16 22:07:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-eaf5a12c-dfeb-40ff-9a43-065d9500b591 tempest-VolumeAndVolumeTypeFromImageTest-590555128 None] Lock "cinder-979590be-a2bc-4f54-93fc-975d0667b143-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Flow 'volume_create_manager' (80545436-58f0-4b7f-aede-3d511b0f4c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b40652-87b1-4224-b000-edb28a4b2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b40652-87b1-4224-b000-edb28a4b2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809666577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1c4bb1224b4856b027525ded3f72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:41Z,use_quota=True,user_id='281cc984bcd0469280951d420a41533f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ad4cf3-d435-472c-be9c-438217e70960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ad4cf3-d435-472c-be9c-438217e70960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c27927-0070-470b-9924-bfd72aa02a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c27927-0070-470b-9924-bfd72aa02a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7', 'volume_name': 'volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5164a1-1ec5-4189-a9d2-b2808799248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5164a1-1ec5-4189-a9d2-b2808799248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e0748-2c19-4563-95dc-36516ab807a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:40 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Volume f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7', 'volume_size': 1}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809666577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1c4bb1224b4856b027525ded3f72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:41Z,use_quota=True,user_id='281cc984bcd0469280951d420a41533f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Creating volume f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:40 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:40 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 1073741824
Sep 16 22:07:40 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:41 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 1073741824" returned: 0 in 0.447s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:41 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7
Sep 16 22:07:41 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:41 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297e0748-2c19-4563-95dc-36516ab807a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e10bf-223a-4044-842e-a0b3b64dc1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:41 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Volume volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 (f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7): created successfully
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4e10bf-223a-4044-842e-a0b3b64dc1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Flow 'volume_create_manager' (80545436-58f0-4b7f-aede-3d511b0f4c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ca003335-ff41-4d77-a8d7-df671ddb30c5 tempest-ProjectReaderTests-1191533212 None] Created volume successfully.
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Acquiring lock "cinder-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "cinder-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Acquiring lock "cinder-quobyte-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "cinder-quobyte-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee438c2a-de6d-4ad3-a920-8a1439e762b5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:42 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7
Sep 16 22:07:42 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:42 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:42 devstack sudo[104362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7
Sep 16 22:07:42 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:42 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "cinder-quobyte-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7" released by "delete_volume" :: held 0.669s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Created reservations ['8475bfa3-6617-44e2-816e-d5eaf186cfcd', 'dc25b992-d5ae-4dcf-9878-7fe27c9bb638', 'e00ba97c-f2f9-4672-a51d-dc36deeb106a', '45df5ddf-0786-4c6c-8671-f5333f034ca5'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:42 devstack sudo[104366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:42 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:43 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Deleted volume successfully.
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3e414ecf-be8d-45ec-8ada-32fc2ec6a3b4 tempest-ProjectReaderTests-1191533212 None] Lock "cinder-f51276a6-2fd1-44bd-b0b5-e4da6ba91bc7-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Flow 'volume_create_manager' (3765744b-acd9-49fa-afc2-5774fb56267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765f32d-678c-4de6-88e9-fe0ed3ce32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765f32d-678c-4de6-88e9-fe0ed3ce32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058311136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1c4bb1224b4856b027525ded3f72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:44Z,use_quota=True,user_id='281cc984bcd0469280951d420a41533f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29373228-8f2d-41d7-abbc-a91faaf1a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29373228-8f2d-41d7-abbc-a91faaf1a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b969143a-f946-45b3-b7aa-64b22da7be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b969143a-f946-45b3-b7aa-64b22da7be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4', 'volume_name': 'volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f71c1a-7f61-42f4-8533-60e21d8addf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f71c1a-7f61-42f4-8533-60e21d8addf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350742f6-8823-41e5-a42c-030de508f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Volume 41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4', 'volume_size': 1}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058311136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1c4bb1224b4856b027525ded3f72b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:44Z,use_quota=True,user_id='281cc984bcd0469280951d420a41533f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Creating volume 41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:43 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:43 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 1073741824
Sep 16 22:07:43 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Flow 'volume_create_manager' (29632ce2-36d7-4cff-8427-ce16d9cc08fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202e7264-ee94-4ae2-99dd-a5174ae89796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202e7264-ee94-4ae2-99dd-a5174ae89796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1435119989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48267e-b68c-403a-9ea9-21fd808d505b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eaeaa84f9a44904a9eda3ac9d905576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:44Z,use_quota=True,user_id='7349d8431ba74a5aabdea61770d763d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400166b7-674e-46ca-840b-7feda8593dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400166b7-674e-46ca-840b-7feda8593dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511266e9-12a3-4174-beb8-10a641b19158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511266e9-12a3-4174-beb8-10a641b19158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e48267e-b68c-403a-9ea9-21fd808d505b', 'volume_name': 'volume-2e48267e-b68c-403a-9ea9-21fd808d505b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d04b7a-1bb4-4bef-ad9b-264691e947dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d04b7a-1bb4-4bef-ad9b-264691e947dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d90db8-cf2e-455a-b648-e8cb44ea8cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Volume 2e48267e-b68c-403a-9ea9-21fd808d505b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e48267e-b68c-403a-9ea9-21fd808d505b', 'volume_size': 1}
Sep 16 22:07:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:44 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 1073741824" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:44 devstack sudo[104375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4
Sep 16 22:07:44 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:44 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1435119989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48267e-b68c-403a-9ea9-21fd808d505b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eaeaa84f9a44904a9eda3ac9d905576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:44Z,use_quota=True,user_id='7349d8431ba74a5aabdea61770d763d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Creating volume 2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:44 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350742f6-8823-41e5-a42c-030de508f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:44 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b 1073741824
Sep 16 22:07:44 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b6d933-a452-4883-8e48-c0496090dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Volume volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 (41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4): created successfully
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b6d933-a452-4883-8e48-c0496090dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Flow 'volume_create_manager' (3765744b-acd9-49fa-afc2-5774fb56267a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-77cbfdc2-a915-4ce7-aa15-140ae28bb1fc tempest-ProjectReaderTests-1191533212 None] Created volume successfully.
Sep 16 22:07:44 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b 1073741824" returned: 0 in 0.405s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:45 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:07:45 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:45 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d90db8-cf2e-455a-b648-e8cb44ea8cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e48267e-b68c-403a-9ea9-21fd808d505b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd7bd55-e44b-4e53-811f-8fa36a8e65e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Volume volume-2e48267e-b68c-403a-9ea9-21fd808d505b (2e48267e-b68c-403a-9ea9-21fd808d505b): created successfully
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd7bd55-e44b-4e53-811f-8fa36a8e65e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Flow 'volume_create_manager' (29632ce2-36d7-4cff-8427-ce16d9cc08fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4487be9c-4256-472e-b2fb-f22a6fcf543a tempest-VolumeDependencyTests-533296300 None] Created volume successfully.
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Acquiring lock "cinder-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "cinder-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Acquiring lock "cinder-quobyte-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "cinder-quobyte-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c9bb7e-0865-4f23-b73f-6cb2afc8f613]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:45 devstack sudo[104419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4
Sep 16 22:07:45 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Creating offline snapshot cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 of volume 2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[738fef24-f3e1-43fb-8f36-f9b6a46556a6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:46 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:07:46 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:46 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" returned: 0 in 0.419s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:46 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4
Sep 16 22:07:46 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:46 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.401s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:46 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 1G
Sep 16 22:07:46 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:46 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "cinder-quobyte-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4" released by "delete_volume" :: held 0.738s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Created reservations ['e3eae88b-4344-4034-ba7e-e54fe056d1c2', '5a16e796-0dec-453c-b280-1b376291d06a', '57d588e1-c8db-4868-b96a-b814d3bf47df', '909307c4-4c6a-4c87-8d3b-c781a883192e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:46 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:07:46 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:46 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 1G" returned: 0 in 0.444s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48267e-b68c-403a-9ea9-21fd808d505b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:46 devstack sudo[104444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48267e-b68c-403a-9ea9-21fd808d505b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:46 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:46 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:07:46 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Deleted volume successfully.
Sep 16 22:07:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5c37b1dd-2ed6-4f06-938a-98fcd3e84d6b tempest-ProjectReaderTests-1191533212 None] Lock "cinder-41eb3588-e31f-43a8-9ce3-b4cb3b72b1e4-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:47 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48267e-b68c-403a-9ea9-21fd808d505b -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.320s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 is being set with open permissions: ugo+rw
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:47 devstack sudo[104450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:47 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:47 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:47 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info
Sep 16 22:07:47 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:47 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info" returned: 0 in 0.270s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info is being set with open permissions: ugo+rw
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:47 devstack sudo[104456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info
Sep 16 22:07:47 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:47 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.info" returned: 0 in 0.294s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d6851f36-1411-497d-bd1a-bee7c1ad73b9 tempest-VolumeDependencyTests-533296300 None] Create snapshot completed successfully
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Flow 'volume_create_manager' (d26c3198-25a7-40c9-b17c-c8023fe76525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22184ca6-5bf3-4c5b-accf-b11947d4efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22184ca6-5bf3-4c5b-accf-b11947d4efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1539672248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caadc859-0b72-4746-b1ce-ac2e453fb871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eaeaa84f9a44904a9eda3ac9d905576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:49Z,use_quota=True,user_id='7349d8431ba74a5aabdea61770d763d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54802644-b2f9-424e-ad4d-abe7ed0c8259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54802644-b2f9-424e-ad4d-abe7ed0c8259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d662ed7c-3c63-47bf-ace1-68d90d6e24d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d662ed7c-3c63-47bf-ace1-68d90d6e24d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'caadc859-0b72-4746-b1ce-ac2e453fb871', 'volume_name': 'volume-caadc859-0b72-4746-b1ce-ac2e453fb871', 'volume_size': 1, 'snapshot_id': 'cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be70c98-6572-4581-bb25-a3548d060693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be70c98-6572-4581-bb25-a3548d060693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62131d1-3dc1-4b87-afe9-057f3693560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Volume caadc859-0b72-4746-b1ce-ac2e453fb871: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-caadc859-0b72-4746-b1ce-ac2e453fb871', 'volume_size': 1, 'snapshot_id': 'cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44'}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-caadc859-0b72-4746-b1ce-ac2e453fb871" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-caadc859-0b72-4746-b1ce-ac2e453fb871" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Creating volume caadc859-0b72-4746-b1ce-ac2e453fb871 from snapshot cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] snapshot: cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44, volume: caadc859-0b72-4746-b1ce-ac2e453fb871,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce22571a-8e9e-489f-a62d-de7422fcf189]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:49 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:49 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:50 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e48267e-b68c-403a-9ea9-21fd808d505b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4bd712-4b66-4c4b-8fd8-4fcf301ebfe1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:50 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:07:50 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:50 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:07:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:50 devstack sudo[104476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871
Sep 16 22:07:50 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (3a9be719-3d68-4efd-94d2-143dc5465488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e298e156-8158-4f74-976b-712ea534b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e298e156-8158-4f74-976b-712ea534b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129478067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd6dece-6c1a-47a0-a188-eff92b5f203e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:57Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf8ff0b-0fae-4015-9d40-d9162c5ddbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf8ff0b-0fae-4015-9d40-d9162c5ddbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf73d1e-b29e-4f1e-9724-55efff78f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf73d1e-b29e-4f1e-9724-55efff78f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd6dece-6c1a-47a0-a188-eff92b5f203e', 'volume_name': 'volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edea6b9-7d21-4ef3-8a6d-091d153d186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7edea6b9-7d21-4ef3-8a6d-091d153d186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b1614e-fa9d-42f9-a914-83965cf57c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:57 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Volume 4bd6dece-6c1a-47a0-a188-eff92b5f203e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e', 'volume_size': 1}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:57 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871" returned: 0 in 7.099s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:07:57 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Converted 1024.00 MB image at 144.22 MB/s
Sep 16 22:07:57 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 is being set with open permissions: ugo+rw
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:57 devstack sudo[104490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871
Sep 16 22:07:57 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:57 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" released by "_copy_volume_from_snapshot" :: held 8.263s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-caadc859-0b72-4746-b1ce-ac2e453fb871" released by "_create_volume_from_snapshot" :: held 8.326s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.351s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129478067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd6dece-6c1a-47a0-a188-eff92b5f203e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:07:57Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Creating volume 4bd6dece-6c1a-47a0-a188-eff92b5f203e {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:07:58 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:58 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e 1073741824
Sep 16 22:07:58 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62131d1-3dc1-4b87-afe9-057f3693560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caadc859-0b72-4746-b1ce-ac2e453fb871', 'volume_size': 1, 'snapshot_id': 'cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0f019b-fa5e-49c9-8c82-deb9bb379aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Volume volume-caadc859-0b72-4746-b1ce-ac2e453fb871 (caadc859-0b72-4746-b1ce-ac2e453fb871): created successfully
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0f019b-fa5e-49c9-8c82-deb9bb379aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Flow 'volume_create_manager' (d26c3198-25a7-40c9-b17c-c8023fe76525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-913fb834-3649-43c8-a3c9-19c00df50bb1 tempest-VolumeDependencyTests-533296300 None] Created volume successfully.
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Deleting offline snapshot cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 of volume 2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] snapshot_file for this snap is: volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f5d10-89ee-49f9-b0c4-b0788c50dc38]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:58 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e 1073741824" returned: 0 in 0.462s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:58 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:58 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:58 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e
Sep 16 22:07:58 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:58 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e" returned: 0 in 0.247s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:07:58 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b1614e-fa9d-42f9-a914-83965cf57c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa8b05-8394-4548-a5a2-ae8d81de2280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e48267e-b68c-403a-9ea9-21fd808d505b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:07:58 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Volume volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e (4bd6dece-6c1a-47a0-a188-eff92b5f203e): created successfully
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa8b05-8394-4548-a5a2-ae8d81de2280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (3a9be719-3d68-4efd-94d2-143dc5465488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd6930-98e5-43ce-a4fb-8488b8b50f8d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dc31f6e2-8452-4e11-b911-3a82ec2c0986 tempest-ProjectReaderTests-804251774 None] Created volume successfully.
Sep 16 22:07:58 devstack sudo[104507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:07:58 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:59 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.533s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:59 devstack sudo[104512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:59 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-4bd6dece-6c1a-47a0-a188-eff92b5f203e-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "cinder-4bd6dece-6c1a-47a0-a188-eff92b5f203e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-quobyte-4bd6dece-6c1a-47a0-a188-eff92b5f203e" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-4bd6dece-6c1a-47a0-a188-eff92b5f203e" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d92cd-0db3-4978-987f-3e0427269fc0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:59 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:07:59 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44
Sep 16 22:07:59 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:59 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e
Sep 16 22:07:59 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:07:59 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Sep 16 22:07:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b.cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:00 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44" released by "_delete_snapshot" :: held 1.670s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" released by "delete_snapshot" :: held 1.698s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:00 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e
Sep 16 22:08:00 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Created reservations ['93cd3191-9bf1-45de-a695-f569d0371b1d', '946b3e48-bcf2-4f8f-9a75-3b2ffeed7770', 'ea693990-d4e3-4681-9b5e-ce559ef6cfef', '3f063c2d-7bd0-4ceb-a831-d4fb6d3cdb08'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Delete snapshot completed successfully.
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ec02d2fe-eb13-43c5-94d0-bcfeac1507f8 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-cfbd33ce-dcd6-4fe0-86bb-87ffc46c8a44-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:00 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4bd6dece-6c1a-47a0-a188-eff92b5f203e" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-4bd6dece-6c1a-47a0-a188-eff92b5f203e" released by "delete_volume" :: held 0.660s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Created reservations ['71e1302f-aaf3-460b-ab6e-37001efbdb75', '89ceb31e-4695-40a0-ae59-3375d4db1e3a', '8a9159d4-f89f-4ff2-b710-a1a6fb2dc0f8', 'e2fc0431-70ab-4c0d-a454-6db5e93663cd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:00 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:00 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-2e48267e-b68c-403a-9ea9-21fd808d505b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-2e48267e-b68c-403a-9ea9-21fd808d505b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca553bac-d65b-4319-bdeb-3396cc11bb20]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:00 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.264s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Deleted volume successfully.
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-17d29514-f071-4872-a8a5-65559b5176ae tempest-ProjectReaderTests-804251774 None] Lock "cinder-4bd6dece-6c1a-47a0-a188-eff92b5f203e-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:00 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:08:00 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:00 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.395s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:01 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b
Sep 16 22:08:01 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (95a5c976-9e58-4400-955b-9c8e24dfa08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90ec59-770d-4f52-8fc0-b3fe73509824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90ec59-770d-4f52-8fc0-b3fe73509824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754953872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7775f121-c1af-432d-ab0d-c979cabdd267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:01Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321c948f-f886-45f2-b70a-7f5840d98da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321c948f-f886-45f2-b70a-7f5840d98da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:01 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397cfcc-c9e8-4ce6-9970-eeaad3e0c9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7397cfcc-c9e8-4ce6-9970-eeaad3e0c9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7775f121-c1af-432d-ab0d-c979cabdd267', 'volume_name': 'volume-7775f121-c1af-432d-ab0d-c979cabdd267', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f46dbc6-5e1d-45ea-b8ab-b02e57e9763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f46dbc6-5e1d-45ea-b8ab-b02e57e9763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f9f93d-53f2-4b07-9069-88d8fbf99cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Volume 7775f121-c1af-432d-ab0d-c979cabdd267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7775f121-c1af-432d-ab0d-c979cabdd267', 'volume_size': 1}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754953872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7775f121-c1af-432d-ab0d-c979cabdd267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:01Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Creating volume 7775f121-c1af-432d-ab0d-c979cabdd267 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:08:01 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2e48267e-b68c-403a-9ea9-21fd808d505b" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:01 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 1073741824
Sep 16 22:08:01 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-2e48267e-b68c-403a-9ea9-21fd808d505b" released by "delete_volume" :: held 0.755s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Created reservations ['3185ca7a-8e63-4bb2-b8a6-b720113ffa12', '369ef753-dd87-4a25-af42-cf097587e978', '99692783-9ff1-45a8-9328-bc79e8c74b29', 'bfcc3f54-dd95-4f58-857c-8bb86dd06acd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:01 devstack sudo[104542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:01 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-caadc859-0b72-4746-b1ce-ac2e453fb871-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:01 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Deleted volume successfully.
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-caadc859-0b72-4746-b1ce-ac2e453fb871-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-63c2bb33-53e2-40c4-8c17-9160d9654451 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-2e48267e-b68c-403a-9ea9-21fd808d505b-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:01 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 1073741824" returned: 0 in 0.520s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[185fd400-fe93-4dfa-9850-7f31ff2c7fff]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:01 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267
Sep 16 22:08:01 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:01 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871
Sep 16 22:08:01 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:02 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f9f93d-53f2-4b07-9069-88d8fbf99cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7775f121-c1af-432d-ab0d-c979cabdd267', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872a167-5880-4310-a4dd-b9b07e739789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:02 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Volume volume-7775f121-c1af-432d-ab0d-c979cabdd267 (7775f121-c1af-432d-ab0d-c979cabdd267): created successfully
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872a167-5880-4310-a4dd-b9b07e739789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (95a5c976-9e58-4400-955b-9c8e24dfa08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-31017af1-4374-49e3-bfd3-83a3760f8ddb tempest-ProjectReaderTests-804251774 None] Created volume successfully.
Sep 16 22:08:02 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871" returned: 0 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:02 devstack sudo[104557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871
Sep 16 22:08:02 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:02 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-caadc859-0b72-4746-b1ce-ac2e453fb871" returned: 0 in 0.245s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-quobyte-caadc859-0b72-4746-b1ce-ac2e453fb871" released by "delete_volume" :: held 0.677s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Created reservations ['016a0064-56a7-4d27-b4ec-c63998a6f5d4', '4c5dce61-a995-4989-b5c0-f57142fc2ba8', '3051e0f1-fe63-4174-a66c-a086b1bcadf6', 'fa76c5b9-40b7-479b-8c09-becf8e819410'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:02 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:02 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:02 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Deleted volume successfully.
Sep 16 22:08:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7f89cda9-e2e4-40b9-8707-0782524ae7b9 tempest-VolumeDependencyTests-533296300 None] Lock "cinder-caadc859-0b72-4746-b1ce-ac2e453fb871-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-7775f121-c1af-432d-ab0d-c979cabdd267-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "cinder-7775f121-c1af-432d-ab0d-c979cabdd267-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-quobyte-7775f121-c1af-432d-ab0d-c979cabdd267" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-7775f121-c1af-432d-ab0d-c979cabdd267" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2bfcf-f97e-408c-bbec-92e1043ef80f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:03 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267
Sep 16 22:08:03 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:03 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267" returned: 0 in 0.395s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:03 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267
Sep 16 22:08:03 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:04 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7775f121-c1af-432d-ab0d-c979cabdd267" returned: 0 in 0.271s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-7775f121-c1af-432d-ab0d-c979cabdd267" released by "delete_volume" :: held 0.713s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Created reservations ['167c30cb-0591-4f38-be06-a41e9cad164f', '1c43fa61-11ef-40ee-a74d-fcea373a0aab', 'bea6355e-eb9a-4309-992c-967046584767', 'f1f692c1-32e9-47c2-9fe0-67c9d28efc55'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:04 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:04 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:04 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Deleted volume successfully.
Sep 16 22:08:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ea0b10c-446f-4869-ae48-0b742d1c9a4e tempest-ProjectReaderTests-804251774 None] Lock "cinder-7775f121-c1af-432d-ab0d-c979cabdd267-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (3d643c41-a886-4927-af47-20a1cd20f144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad905a-d156-42b8-9e4a-2eab43616664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad905a-d156-42b8-9e4a-2eab43616664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677812258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660cb3aa-1386-4e02-9b18-6537b9bfc10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:05Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca21a32-7c4a-4653-a198-181082cbe465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca21a32-7c4a-4653-a198-181082cbe465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8072f1-3b28-4216-8b7a-83178c495e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8072f1-3b28-4216-8b7a-83178c495e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660cb3aa-1386-4e02-9b18-6537b9bfc10e', 'volume_name': 'volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46290c42-849b-4892-ba55-d5191a51803a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46290c42-849b-4892-ba55-d5191a51803a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c1e034-b1ee-4de5-b0c5-6cbc1ee3e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Volume 660cb3aa-1386-4e02-9b18-6537b9bfc10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e', 'volume_size': 1}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677812258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660cb3aa-1386-4e02-9b18-6537b9bfc10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:05Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Creating volume 660cb3aa-1386-4e02-9b18-6537b9bfc10e {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:08:05 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:05 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e 1073741824
Sep 16 22:08:05 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:05 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e 1073741824" returned: 0 in 0.450s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:05 devstack sudo[104582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e
Sep 16 22:08:05 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:05 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e" returned: 0 in 0.264s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c1e034-b1ee-4de5-b0c5-6cbc1ee3e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda42c64-4ead-435c-ae1f-eb6f36bc291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Volume volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e (660cb3aa-1386-4e02-9b18-6537b9bfc10e): created successfully
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda42c64-4ead-435c-ae1f-eb6f36bc291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (3d643c41-a886-4927-af47-20a1cd20f144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5b575e57-02e8-48c8-9804-0985fa170fdd tempest-ProjectReaderTests-804251774 None] Created volume successfully.
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-660cb3aa-1386-4e02-9b18-6537b9bfc10e-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "cinder-660cb3aa-1386-4e02-9b18-6537b9bfc10e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-quobyte-660cb3aa-1386-4e02-9b18-6537b9bfc10e" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-660cb3aa-1386-4e02-9b18-6537b9bfc10e" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c086357a-b88c-447e-a897-f490bab2bdc4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:06 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e
Sep 16 22:08:06 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:06 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:06 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e
Sep 16 22:08:06 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:06 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-660cb3aa-1386-4e02-9b18-6537b9bfc10e" returned: 0 in 0.257s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-660cb3aa-1386-4e02-9b18-6537b9bfc10e" released by "delete_volume" :: held 0.684s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Created reservations ['7d9851e6-9a56-421c-92c8-819023281d8e', '99091a3c-dc87-4887-aaec-c4be67f80055', '5f195d9c-de97-48cc-b36e-41367b03ef49', 'd3c101ec-03c5-4b3e-95a5-c66a7ca24a03'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:07 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:07 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:07 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Deleted volume successfully.
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-26e85c2c-26c2-4521-a4b8-1cb53fe97546 tempest-ProjectReaderTests-804251774 None] Lock "cinder-660cb3aa-1386-4e02-9b18-6537b9bfc10e-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (19bfecd9-7df1-4a89-9f6a-942defb9d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479bad4-8e87-44eb-92c0-98b8ff681d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c479bad4-8e87-44eb-92c0-98b8ff681d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260947572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09cb921-0e76-441d-85d8-ab5cdc776a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:08Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c82648b-0978-40aa-80d8-fc4f7830679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c82648b-0978-40aa-80d8-fc4f7830679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e371bc5-55b7-4926-bcd9-383aeccf9abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e371bc5-55b7-4926-bcd9-383aeccf9abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09cb921-0e76-441d-85d8-ab5cdc776a6a', 'volume_name': 'volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3767e-978a-411f-a4f4-0a74c212cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3767e-978a-411f-a4f4-0a74c212cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a76786-dbc5-4cb1-89ef-d525b73f1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Volume d09cb921-0e76-441d-85d8-ab5cdc776a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a', 'volume_size': 1}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260947572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09cb921-0e76-441d-85d8-ab5cdc776a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76d883aedb874d9dbc317a404693faf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:08Z,use_quota=True,user_id='26bd649097b74395a67c8555435f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Creating volume d09cb921-0e76-441d-85d8-ab5cdc776a6a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:08:07 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:08:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:07 devstack sudo[104596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a 1073741824
Sep 16 22:08:07 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:08 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a 1073741824" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:08 devstack sudo[104602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a
Sep 16 22:08:08 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:08 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a76786-dbc5-4cb1-89ef-d525b73f1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6768b414-8c8b-4ab0-a6d3-1408cd307880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Volume volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a (d09cb921-0e76-441d-85d8-ab5cdc776a6a): created successfully
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6768b414-8c8b-4ab0-a6d3-1408cd307880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Flow 'volume_create_manager' (19bfecd9-7df1-4a89-9f6a-942defb9d716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ee3aa439-846a-4bea-b8c3-25abc5381244 tempest-ProjectReaderTests-804251774 None] Created volume successfully.
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-d09cb921-0e76-441d-85d8-ab5cdc776a6a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "cinder-d09cb921-0e76-441d-85d8-ab5cdc776a6a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Acquiring lock "cinder-quobyte-d09cb921-0e76-441d-85d8-ab5cdc776a6a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-d09cb921-0e76-441d-85d8-ab5cdc776a6a" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd9ec09-a0e6-472a-8f72-ebef6e8b3aa8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:09 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a
Sep 16 22:08:09 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:09 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:09 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a
Sep 16 22:08:09 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:09 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d09cb921-0e76-441d-85d8-ab5cdc776a6a" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "cinder-quobyte-d09cb921-0e76-441d-85d8-ab5cdc776a6a" released by "delete_volume" :: held 0.661s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Created reservations ['e0843216-6dc5-404c-9cdd-6a20625efe4c', '9f1da45c-643d-4324-8693-ecc7eabfb897', 'fd157fb0-7f96-4c77-9c01-d36de34ed0bc', 'ebe503d2-1f11-46b9-aa23-3b377cab38a8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:09 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:09 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:09 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Deleted volume successfully.
Sep 16 22:08:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-374c0dac-f2db-471c-acde-c4d0ab2f22d4 tempest-ProjectReaderTests-804251774 None] Lock "cinder-d09cb921-0e76-441d-85d8-ab5cdc776a6a-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:19 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=138,cinder:INSERT=54,cinder:UPDATE=180,cinder:DELETE=17 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:08:19 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=136,cinder:UPDATE=198,cinder:INSERT=45,cinder:DELETE=16 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:22 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:22 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:22 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:08:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Flow 'volume_create_manager' (6a5f3a34-4ab2-4f22-a668-0d6d88d4ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81edea56-4cd1-482d-b021-e101f180e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81edea56-4cd1-482d-b021-e101f180e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1194662019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1eb08a-c42a-42e5-b2a7-93ffc6886736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c841d6368e874d6599c154277d827ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:36Z,use_quota=True,user_id='0133217106144b37b69b4695b0790ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7b0e48-88ba-4cae-b47c-7b33ac903cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7b0e48-88ba-4cae-b47c-7b33ac903cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6da341-ae68-43aa-9e1a-6f89be565a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6da341-ae68-43aa-9e1a-6f89be565a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf1eb08a-c42a-42e5-b2a7-93ffc6886736', 'volume_name': 'volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fe87ab-f2db-4bc7-89da-ca6851dab8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fe87ab-f2db-4bc7-89da-ca6851dab8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb541e88-7296-4922-9b6a-c8a3dc9b2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Volume bf1eb08a-c42a-42e5-b2a7-93ffc6886736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736', 'volume_size': 1}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1194662019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1eb08a-c42a-42e5-b2a7-93ffc6886736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c841d6368e874d6599c154277d827ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:36Z,use_quota=True,user_id='0133217106144b37b69b4695b0790ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Creating volume bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:08:35 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:08:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:35 devstack sudo[104627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 1073741824
Sep 16 22:08:35 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:36 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 1073741824" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:36 devstack sudo[104632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:36 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:36 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb541e88-7296-4922-9b6a-c8a3dc9b2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b053ce92-c945-4745-9266-abc283bf5036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:36 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Volume volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 (bf1eb08a-c42a-42e5-b2a7-93ffc6886736): created successfully
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b053ce92-c945-4745-9266-abc283bf5036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Flow 'volume_create_manager' (6a5f3a34-4ab2-4f22-a668-0d6d88d4ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cbcab8c6-7076-469a-8cb2-7503c97ab5bc tempest-SnapshotDependencyTests-1316623770 None] Created volume successfully.
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Creating offline snapshot 50c31a60-601b-4f50-b2b3-13ae5a5e0018 of volume bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1cb9c1-e79c-439e-b00a-20b23901f5ee]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:37 devstack sudo[104635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:37 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:37 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.355s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:37 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 1G
Sep 16 22:08:37 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:37 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 1G" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:37 devstack sudo[104645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:37 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:38 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.284s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:38 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 is being set with open permissions: ugo+rw
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:38 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:38 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:38 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.232s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:38 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info
Sep 16 22:08:38 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:38 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:38 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info is being set with open permissions: ugo+rw
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:38 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info
Sep 16 22:08:38 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:38 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.info" returned: 0 in 0.234s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:38 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-dc91b19b-5237-4039-a42d-2babe0866f6b tempest-SnapshotDependencyTests-1316623770 None] Create snapshot completed successfully
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Flow 'volume_create_manager' (39f5b97f-f644-4c98-8cef-0768c501d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211a466d-cd4e-4913-9481-7be1baa06d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211a466d-cd4e-4913-9481-7be1baa06d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9d3ed3-5f40-4536-b28c-5f8707e85de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c841d6368e874d6599c154277d827ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50c31a60-601b-4f50-b2b3-13ae5a5e0018,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:08:40Z,use_quota=True,user_id='0133217106144b37b69b4695b0790ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507b20a7-81e5-470c-9e66-983ea86778d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507b20a7-81e5-470c-9e66-983ea86778d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07e8c5f-ea5d-4126-88aa-384622deaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07e8c5f-ea5d-4126-88aa-384622deaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f9d3ed3-5f40-4536-b28c-5f8707e85de3', 'volume_name': 'volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3', 'volume_size': 1, 'snapshot_id': '50c31a60-601b-4f50-b2b3-13ae5a5e0018'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862cfd1-41e8-4016-af49-743a693ddd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7862cfd1-41e8-4016-af49-743a693ddd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a4f64-e1f5-49e8-852d-2811331975a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:39 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Volume 4f9d3ed3-5f40-4536-b28c-5f8707e85de3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3', 'volume_size': 1, 'snapshot_id': '50c31a60-601b-4f50-b2b3-13ae5a5e0018'}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Creating volume 4f9d3ed3-5f40-4536-b28c-5f8707e85de3 from snapshot 50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] snapshot: 50c31a60-601b-4f50-b2b3-13ae5a5e0018, volume: 4f9d3ed3-5f40-4536-b28c-5f8707e85de3,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57f440-5c73-4f20-922d-b35433e7f9e3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:39 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:39 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:40 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.366s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f2ed7-1b4b-449c-84fe-06c23f178183]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:40 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:40 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:40 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.347s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:08:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:40 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3
Sep 16 22:08:40 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:46 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" returned: 0 in 5.831s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:08:46 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Converted 1024.00 MB image at 175.54 MB/s
Sep 16 22:08:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 is being set with open permissions: ugo+rw
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:46 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3
Sep 16 22:08:46 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:46 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" returned: 0 in 0.239s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" released by "_copy_volume_from_snapshot" :: held 6.857s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" released by "_create_volume_from_snapshot" :: held 6.920s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.937s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a4f64-e1f5-49e8-852d-2811331975a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3', 'volume_size': 1, 'snapshot_id': '50c31a60-601b-4f50-b2b3-13ae5a5e0018'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74582b72-b96a-4e61-8435-043580ee0fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:08:46 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Volume volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 (4f9d3ed3-5f40-4536-b28c-5f8707e85de3): created successfully
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74582b72-b96a-4e61-8435-043580ee0fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:08:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Flow 'volume_create_manager' (39f5b97f-f644-4c98-8cef-0768c501d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:08:46 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c73fe189-c05d-4b28-ba99-85656786eef4 tempest-SnapshotDependencyTests-1316623770 None] Created volume successfully.
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-50c31a60-601b-4f50-b2b3-13ae5a5e0018-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-50c31a60-601b-4f50-b2b3-13ae5a5e0018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Deleting offline snapshot 50c31a60-601b-4f50-b2b3-13ae5a5e0018 of volume bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] snapshot_file for this snap is: volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd92e7a-7579-419e-84e5-ef00c934074b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:47 devstack sudo[104723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:47 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:47 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f9c3e1-36ad-4107-aeaa-326c05fabdc1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:47 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:47 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:48 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.520s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:48 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:48 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:48 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.323s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:48 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018
Sep 16 22:08:48 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:48 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736.50c31a60-601b-4f50-b2b3-13ae5a5e0018" returned: 0 in 0.236s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-50c31a60-601b-4f50-b2b3-13ae5a5e0018" released by "_delete_snapshot" :: held 1.527s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" released by "delete_snapshot" :: held 1.548s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Created reservations ['96e3be29-5c3b-4c80-9f45-27d144b94cd3', '754219e6-5fab-4328-8c0b-e6da5b2175a1', '8f2ab403-2eb0-4f7e-95e0-83f6ae5af73d', '4e969254-830e-46a4-8777-f97be756ffb1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Delete snapshot completed successfully.
Sep 16 22:08:48 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2d3993b8-dcf6-4a02-8331-9415c7942a22 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-50c31a60-601b-4f50-b2b3-13ae5a5e0018-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-bf1eb08a-c42a-42e5-b2a7-93ffc6886736-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-bf1eb08a-c42a-42e5-b2a7-93ffc6886736-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" acquired by "delete_volume" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca483428-d3ff-450e-866f-7e21145f2699]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:49 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:49 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:49 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.352s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:49 devstack sudo[104753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736
Sep 16 22:08:49 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:50 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" returned: 0 in 0.239s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-bf1eb08a-c42a-42e5-b2a7-93ffc6886736" released by "delete_volume" :: held 0.650s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Created reservations ['88fc1091-a9f4-4474-b90c-053351b0f084', '8d882559-a44b-4721-85b9-ad9f5d45aab8', '717440fa-6f81-4c3e-a91b-37473d61ae26', '54888ffa-455d-4bbe-8b5c-2c3fd1baad62'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:50 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:50 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:50 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.234s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Deleted volume successfully.
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-91213c24-c243-4afb-a8db-b97dff57bb6f tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-bf1eb08a-c42a-42e5-b2a7-93ffc6886736-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-4f9d3ed3-5f40-4536-b28c-5f8707e85de3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-4f9d3ed3-5f40-4536-b28c-5f8707e85de3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" acquired by "delete_volume" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416c41f-4b2a-431d-a8e5-2e2a278c0449]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:08:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:50 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3
Sep 16 22:08:50 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:51 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" returned: 0 in 0.349s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:51 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3
Sep 16 22:08:51 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:51 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" returned: 0 in 0.239s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-quobyte-4f9d3ed3-5f40-4536-b28c-5f8707e85de3" released by "delete_volume" :: held 0.629s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Created reservations ['12b689ba-5e27-4dc6-bdff-8d36a927af14', 'd8c0941e-c56d-43ab-86f3-cf22210a5601', 'b1bc126c-106e-45fb-9d70-92e863baa6a7', 'e68fe0a8-a215-46a3-ad99-54dd0cc9afc1'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:08:51 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:08:51 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:08:51 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.232s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:08:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Deleted volume successfully.
Sep 16 22:08:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bc7a097a-6f17-4089-b3b5-7701b20a36b8 tempest-SnapshotDependencyTests-1316623770 None] Lock "cinder-4f9d3ed3-5f40-4536-b28c-5f8707e85de3-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:01 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=3 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:09:01 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (c0a481be-0b58-4185-b77e-df52c90a7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93072e1-d8e2-44ec-93b4-4ce3e628d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93072e1-d8e2-44ec-93b4-4ce3e628d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67612178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0add91-9bd9-4130-afe4-9aa4312ea5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:11Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2933ed69-ab9b-4f4a-91ef-1772624ca10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2933ed69-ab9b-4f4a-91ef-1772624ca10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90d3911-37df-4d54-9884-b2631cf6ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90d3911-37df-4d54-9884-b2631cf6ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0add91-9bd9-4130-afe4-9aa4312ea5da', 'volume_name': 'volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da692ca2-fa17-4a30-8e7b-63710f462872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da692ca2-fa17-4a30-8e7b-63710f462872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776be99a-627d-4584-8506-d3e14f068286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 8a0add91-9bd9-4130-afe4-9aa4312ea5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da', 'volume_size': 1}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67612178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0add91-9bd9-4130-afe4-9aa4312ea5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:11Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 8a0add91-9bd9-4130-afe4-9aa4312ea5da {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:11 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:11 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da 1073741824
Sep 16 22:09:11 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (ceadf076-1fec-4901-bc41-f79a91275fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c04d0b6-5629-421b-9c55-f3138794255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c04d0b6-5629-421b-9c55-f3138794255d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21112283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6b14a-c222-45e8-a238-78e6e0929a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:11Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045d61c-91f1-4256-95af-19b0fb2e1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d045d61c-91f1-4256-95af-19b0fb2e1421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576a5c5b-21c0-40fd-b4ca-79b6428370a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576a5c5b-21c0-40fd-b4ca-79b6428370a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e6b14a-c222-45e8-a238-78e6e0929a67', 'volume_name': 'volume-a2e6b14a-c222-45e8-a238-78e6e0929a67', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf111943-b38e-4583-962d-1d486d781fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf111943-b38e-4583-962d-1d486d781fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862899c2-d169-49de-b4e9-9a6914ea23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Volume a2e6b14a-c222-45e8-a238-78e6e0929a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e6b14a-c222-45e8-a238-78e6e0929a67', 'volume_size': 1}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (97e56a12-0cda-42c2-b27f-0a98af02542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57920f75-de93-4d90-a9e4-f0ea8556bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57920f75-de93-4d90-a9e4-f0ea8556bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-751611420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484c025e-f228-4fee-b58a-0052db147987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:12Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410104ad-2d89-4cc7-b5c1-41c7c04f0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410104ad-2d89-4cc7-b5c1-41c7c04f0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c355452d-b5d1-4059-b5f2-531eb9c3f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c355452d-b5d1-4059-b5f2-531eb9c3f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484c025e-f228-4fee-b58a-0052db147987', 'volume_name': 'volume-484c025e-f228-4fee-b58a-0052db147987', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873b958c-95d8-40b0-bfb6-2611f8788a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873b958c-95d8-40b0-bfb6-2611f8788a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63791a4-b2db-488c-bae4-47afca95cc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Volume 484c025e-f228-4fee-b58a-0052db147987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484c025e-f228-4fee-b58a-0052db147987', 'volume_size': 1}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:12 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da 1073741824" returned: 0 in 0.663s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:12 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da
Sep 16 22:09:12 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:12 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21112283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6b14a-c222-45e8-a238-78e6e0929a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:11Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Creating volume a2e6b14a-c222-45e8-a238-78e6e0929a67 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:12 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 1073741824
Sep 16 22:09:12 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776be99a-627d-4584-8506-d3e14f068286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea482bc-1571-4859-a816-5ae4a91ee98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da (8a0add91-9bd9-4130-afe4-9aa4312ea5da): created successfully
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea482bc-1571-4859-a816-5ae4a91ee98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (c0a481be-0b58-4185-b77e-df52c90a7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f1b2e876-c038-495b-9c76-2de8167d5be0 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Flow 'volume_create_manager' (825cd184-7d7e-4459-b8a5-17a7ee0a6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3b251-82b3-4187-a373-88986afafab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (c68c0ab6-d5d8-4dbb-b30e-93a6d2f4496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8786a183-97bb-434f-93d2-e6068c830c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8786a183-97bb-434f-93d2-e6068c830c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042020781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05229983-0941-4dba-88ed-58d87da3c54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad40508-24a7-4f1a-897a-3af8b6f135e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad40508-24a7-4f1a-897a-3af8b6f135e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cc6353-b5f2-4a4a-ab35-9a112b38a031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cc6353-b5f2-4a4a-ab35-9a112b38a031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05229983-0941-4dba-88ed-58d87da3c54f', 'volume_name': 'volume-05229983-0941-4dba-88ed-58d87da3c54f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c77529-2756-445a-bc85-df2ecb14b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c77529-2756-445a-bc85-df2ecb14b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f448830f-37ef-4534-97aa-8123312377cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Volume 05229983-0941-4dba-88ed-58d87da3c54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05229983-0941-4dba-88ed-58d87da3c54f', 'volume_size': 1}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d3b251-82b3-4187-a373-88986afafab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-690942863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50ef888-20d1-42ed-b5f6-8ca0c68027fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fca244b639a492a92ac3389c544bd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:12Z,use_quota=True,user_id='b2356b8ae0f546988198349d3ff1d719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac305e9-17ac-4907-ae50-29b0b093b287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac305e9-17ac-4907-ae50-29b0b093b287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326c2566-ef76-49ef-93d1-6f6a8e7d1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326c2566-ef76-49ef-93d1-6f6a8e7d1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50ef888-20d1-42ed-b5f6-8ca0c68027fc', 'volume_name': 'volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b52285-67ef-41ca-88df-94ee2077434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b52285-67ef-41ca-88df-94ee2077434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d6489f-7026-4f1a-832a-56195feb5afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:12 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Volume a50ef888-20d1-42ed-b5f6-8ca0c68027fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc', 'volume_size': 1}
Sep 16 22:09:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (29cdc2c5-ae4f-4c5d-8ac5-bde12eaee7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964de341-92ba-43b2-a39e-7b80143c9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964de341-92ba-43b2-a39e-7b80143c9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022135407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2b45c-107e-4f83-a426-5c81ed33590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b7e72-2000-497d-8ac1-72ab4de18b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b7e72-2000-497d-8ac1-72ab4de18b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc815998-0c3e-4f65-ad2e-a1d79e3c8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc815998-0c3e-4f65-ad2e-a1d79e3c8a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d2b45c-107e-4f83-a426-5c81ed33590c', 'volume_name': 'volume-01d2b45c-107e-4f83-a426-5c81ed33590c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b20a26-776b-42f1-a6e3-e9e7e1048122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b20a26-776b-42f1-a6e3-e9e7e1048122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe148834-2e24-4b7e-b91e-c56b78c2ce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Volume 01d2b45c-107e-4f83-a426-5c81ed33590c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d2b45c-107e-4f83-a426-5c81ed33590c', 'volume_size': 1}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:13 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 1073741824" returned: 0 in 0.734s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:13 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67
Sep 16 22:09:13 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (ed4ea8d4-1055-43a5-bb4c-b32872609149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16ef00c-55b2-43bd-b79d-c0419a209e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16ef00c-55b2-43bd-b79d-c0419a209e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297710509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999e9bb-db37-4a99-8355-e7016b04a2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ada69-313e-4450-9ba1-8ffb1cf55b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73ada69-313e-4450-9ba1-8ffb1cf55b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5200cb-1477-4e0c-9986-da86faa883f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5200cb-1477-4e0c-9986-da86faa883f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd999e9bb-db37-4a99-8355-e7016b04a2ed', 'volume_name': 'volume-d999e9bb-db37-4a99-8355-e7016b04a2ed', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57047edc-7493-4df3-ac7d-d53af9b76939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57047edc-7493-4df3-ac7d-d53af9b76939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243d8c4-18a1-434b-af65-71b67bbfbaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Volume d999e9bb-db37-4a99-8355-e7016b04a2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d999e9bb-db37-4a99-8355-e7016b04a2ed', 'volume_size': 1}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:13 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-751611420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484c025e-f228-4fee-b58a-0052db147987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:12Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Creating volume 484c025e-f228-4fee-b58a-0052db147987 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:13 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862899c2-d169-49de-b4e9-9a6914ea23e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e6b14a-c222-45e8-a238-78e6e0929a67', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 1073741824
Sep 16 22:09:13 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c144b1-55b8-4ee7-aa03-5135884083c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Volume volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 (a2e6b14a-c222-45e8-a238-78e6e0929a67): created successfully
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c144b1-55b8-4ee7-aa03-5135884083c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (ceadf076-1fec-4901-bc41-f79a91275fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5a5afb70-d346-4cfe-96f7-646b53215a28 tempest-CreateVolumesFromImageTest-991237026 None] Created volume successfully.
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (b366e49c-6064-4ffb-af04-0d501837abfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9467bc-8569-4e31-86a5-8c520cc48556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:13 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9467bc-8569-4e31-86a5-8c520cc48556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808608821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131a22ea-ded7-429d-8ea4-fce10fcc6e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:14Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3197d45-ac85-4c61-8721-294d384a47f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3197d45-ac85-4c61-8721-294d384a47f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f2622f-8896-413e-ba10-811996613131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f2622f-8896-413e-ba10-811996613131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131a22ea-ded7-429d-8ea4-fce10fcc6e4b', 'volume_name': 'volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1b065a-0ddc-4a4d-af5a-2799c3194fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1b065a-0ddc-4a4d-af5a-2799c3194fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e021ef7-2db2-4926-a55c-d348a5c05cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 131a22ea-ded7-429d-8ea4-fce10fcc6e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b', 'volume_size': 1}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:14 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 1073741824" returned: 0 in 0.573s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:14 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987
Sep 16 22:09:14 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (6617eaa6-0860-4a6e-a5a3-ec95b9a01554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2634bd24-ddf7-4f08-89d3-642faae7be21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2634bd24-ddf7-4f08-89d3-642faae7be21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587764745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c39f8d-3824-4b2f-859a-384dedb8b3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:14Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea9f605-0da6-49a0-b8ec-a2450cc124c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea9f605-0da6-49a0-b8ec-a2450cc124c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901bcd5f-cdd4-4f56-aff6-8283bd3867d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901bcd5f-cdd4-4f56-aff6-8283bd3867d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c39f8d-3824-4b2f-859a-384dedb8b3de', 'volume_name': 'volume-58c39f8d-3824-4b2f-859a-384dedb8b3de', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1bf254-fe7e-4bb1-bb8c-68ce1c67ce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1bf254-fe7e-4bb1-bb8c-68ce1c67ce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ba0874-2059-4308-b6f1-b85587725316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 58c39f8d-3824-4b2f-859a-384dedb8b3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c39f8d-3824-4b2f-859a-384dedb8b3de', 'volume_size': 1}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987" returned: 0 in 0.345s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042020781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05229983-0941-4dba-88ed-58d87da3c54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Creating volume 05229983-0941-4dba-88ed-58d87da3c54f {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63791a4-b2db-488c-bae4-47afca95cc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484c025e-f228-4fee-b58a-0052db147987', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f 1073741824
Sep 16 22:09:14 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49395496-2ae7-4dea-ab32-e6db2194cd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Volume volume-484c025e-f228-4fee-b58a-0052db147987 (484c025e-f228-4fee-b58a-0052db147987): created successfully
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49395496-2ae7-4dea-ab32-e6db2194cd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (97e56a12-0cda-42c2-b27f-0a98af02542d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0893aca0-ee11-4a60-b583-411322d9a12b tempest-CreateVolumesFromImageTest-991237026 None] Created volume successfully.
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (a0bdd405-5b17-4ef5-b308-31eecc3a08f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eed3230-ab67-4ec4-bb68-f8d49b0aa4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eed3230-ab67-4ec4-bb68-f8d49b0aa4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228821064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2ac7ec-765f-4408-8c75-9a627a895a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:15Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95fcbc-f652-49df-893b-408fa2ec0f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95fcbc-f652-49df-893b-408fa2ec0f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92607ceb-6f88-4bde-aea9-27dc3f32c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92607ceb-6f88-4bde-aea9-27dc3f32c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e2ac7ec-765f-4408-8c75-9a627a895a9d', 'volume_name': 'volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb46029e-d4ca-4b9a-86a0-3c4a20673b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb46029e-d4ca-4b9a-86a0-3c4a20673b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c869f4c-a4c3-4dc1-89e5-cf79b1861768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:14 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 4e2ac7ec-765f-4408-8c75-9a627a895a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d', 'volume_size': 1}
Sep 16 22:09:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:15 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f 1073741824" returned: 0 in 0.589s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:15 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f
Sep 16 22:09:15 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (e009da0a-5df3-46aa-b6d9-a1f414fd5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5124ac3b-a3de-43d6-af30-15684bda9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5124ac3b-a3de-43d6-af30-15684bda9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61987531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418f583d-4cb6-486e-b979-d7e9c46605f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:15Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086bc384-413b-4e46-beb7-01f254636e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086bc384-413b-4e46-beb7-01f254636e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cbea0e-51e6-42f8-b29f-89807364f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cbea0e-51e6-42f8-b29f-89807364f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418f583d-4cb6-486e-b979-d7e9c46605f9', 'volume_name': 'volume-418f583d-4cb6-486e-b979-d7e9c46605f9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05477abc-eba4-4d13-9c1a-7b71e25d3bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05477abc-eba4-4d13-9c1a-7b71e25d3bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae832d-41f4-4c9a-9c21-a2d07d0a1610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 418f583d-4cb6-486e-b979-d7e9c46605f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418f583d-4cb6-486e-b979-d7e9c46605f9', 'volume_size': 1}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:15 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f" returned: 0 in 0.318s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.609s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-690942863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50ef888-20d1-42ed-b5f6-8ca0c68027fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fca244b639a492a92ac3389c544bd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:12Z,use_quota=True,user_id='b2356b8ae0f546988198349d3ff1d719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Creating volume a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:15 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:15 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc 1073741824
Sep 16 22:09:15 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f448830f-37ef-4534-97aa-8123312377cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05229983-0941-4dba-88ed-58d87da3c54f', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e421bd9-17d5-4eae-bc18-56776940c862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Volume volume-05229983-0941-4dba-88ed-58d87da3c54f (05229983-0941-4dba-88ed-58d87da3c54f): created successfully
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e421bd9-17d5-4eae-bc18-56776940c862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (c68c0ab6-d5d8-4dbb-b30e-93a6d2f4496d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-25a521e4-ecf2-49ba-8c58-88297864bebf tempest-CreateVolumesFromImageTest-991237026 None] Created volume successfully.
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (c6e3b826-6589-4f0b-b26c-9c4ef2694128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d04d1b-d406-4b14-b897-1ffa544f41bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d04d1b-d406-4b14-b897-1ffa544f41bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737706743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a04e0-dca8-4055-929c-5a30bd4f8209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:16Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6db245-456a-4395-8da6-a7a864017fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6db245-456a-4395-8da6-a7a864017fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233cf398-a277-4edb-9f1d-8ac607e6df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233cf398-a277-4edb-9f1d-8ac607e6df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309a04e0-dca8-4055-929c-5a30bd4f8209', 'volume_name': 'volume-309a04e0-dca8-4055-929c-5a30bd4f8209', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30208c17-0309-4af9-a8a4-58e6986f7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30208c17-0309-4af9-a8a4-58e6986f7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038eec6d-72b1-4a1a-a090-9652fd991bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume 309a04e0-dca8-4055-929c-5a30bd4f8209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309a04e0-dca8-4055-929c-5a30bd4f8209', 'volume_size': 1}
Sep 16 22:09:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Flow 'volume_create_manager' (1e78dafd-e2df-41f6-addb-36887c4e07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dffb7c-e02e-46df-b486-1c62135e80c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dffb7c-e02e-46df-b486-1c62135e80c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c4b5c7060430e8aa22503f523fa0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:16Z,use_quota=True,user_id='d36fd0102d6b462f8db5d55a0e4074c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b3f0cf-4eab-468b-932a-61094f3b7343),volume_type_id=c9b3f0cf-4eab-468b-932a-61094f3b7343)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd7e9c5-62a1-4f0d-a8bc-6e608ab850de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd7e9c5-62a1-4f0d-a8bc-6e608ab850de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128dae00-4fa8-4f29-b34a-f83007440955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc 1073741824" returned: 0 in 0.561s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:16 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:16 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128dae00-4fa8-4f29-b34a-f83007440955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3', 'volume_name': 'volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3', 'volume_size': 1, 'image_id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eea937da44b9be87a2af0fc70238563', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c4b5c7060430e8aa22503f523fa0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66bcd16e99e56861cfa73213edc82983db0f94c50ebd482a9b289840f69c9fe2cc4027f5d3e04a7a943774332b2494fd49d9d8f9174133bf2dd5e7ecacf32c48', 'id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'created_at': datetime.datetime(2026, 9, 16, 20, 9, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dba007a-25cc-4549-bf24-1cacf63964e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82aff3fbc0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5929f-fc95-4813-bc97-66431fa5bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5929f-fc95-4813-bc97-66431fa5bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0de353-194b-49f1-94d3-6666c53d6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3', 'volume_size': 1, 'image_id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eea937da44b9be87a2af0fc70238563', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c4b5c7060430e8aa22503f523fa0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66bcd16e99e56861cfa73213edc82983db0f94c50ebd482a9b289840f69c9fe2cc4027f5d3e04a7a943774332b2494fd49d9d8f9174133bf2dd5e7ecacf32c48', 'id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'created_at': datetime.datetime(2026, 9, 16, 20, 9, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dba007a-25cc-4549-bf24-1cacf63964e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82aff3fbc0>}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Trying to clone 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 from image 1dba007a-25cc-4549-bf24-1cacf63964e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:09:16 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022135407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2b45c-107e-4f83-a426-5c81ed33590c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Creating volume 01d2b45c-107e-4f83-a426-5c81ed33590c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:16 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:09:16 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 22:09:16 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c 1073741824
Sep 16 22:09:16 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d6489f-7026-4f1a-832a-56195feb5afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb781d29-4cf7-4c28-a924-126315b6f49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Volume volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc (a50ef888-20d1-42ed-b5f6-8ca0c68027fc): created successfully
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb781d29-4cf7-4c28-a924-126315b6f49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Flow 'volume_create_manager' (825cd184-7d7e-4459-b8a5-17a7ee0a6f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3872e66c-3cd1-48e5-a139-dffe10bf53f7 tempest-VolumeDependencyTests-515976011 None] Created volume successfully.
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e1e010-97b9-47d5-9d03-a4b58f3f58de]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:16 devstack sudo[104859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:16 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:16 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:16 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c 1073741824" returned: 0 in 0.532s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:16 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:16 devstack sudo[104868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c
Sep 16 22:09:16 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:16 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:17 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c" returned: 0 in 0.242s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:17 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.744s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-297710509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999e9bb-db37-4a99-8355-e7016b04a2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07c50a70d71442faf0cf63ee7183daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:13Z,use_quota=True,user_id='39aefc20d5f34262a44a5289c4f91843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Creating volume d999e9bb-db37-4a99-8355-e7016b04a2ed {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:17 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Temporary image 1dba007a-25cc-4549-bf24-1cacf63964e3 is fetched for user d36fd0102d6b462f8db5d55a0e4074c3. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:09:17 devstack sudo[104876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed 1073741824
Sep 16 22:09:17 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe148834-2e24-4b7e-b91e-c56b78c2ce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d2b45c-107e-4f83-a426-5c81ed33590c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e116c4-b090-496b-a972-8025e5cfa667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:17 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Volume volume-01d2b45c-107e-4f83-a426-5c81ed33590c (01d2b45c-107e-4f83-a426-5c81ed33590c): created successfully
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e116c4-b090-496b-a972-8025e5cfa667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (29cdc2c5-ae4f-4c5d-8ac5-bde12eaee7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:17 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c5ad741f-b284-47c0-9473-eb324abe322a tempest-CreateVolumesFromImageTest-991237026 None] Created volume successfully.
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe6960-c191-4d78-aa55-d8a648e2f359]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:17 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:17 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:17 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed 1073741824" returned: 0 in 0.417s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:17 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:17 devstack sudo[104887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed
Sep 16 22:09:17 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:17 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:17 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:17 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.954s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808608821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131a22ea-ded7-429d-8ea4-fce10fcc6e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:14Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 131a22ea-ded7-429d-8ea4-fce10fcc6e4b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:18 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b 1073741824
Sep 16 22:09:18 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:18 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243d8c4-18a1-434b-af65-71b67bbfbaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d999e9bb-db37-4a99-8355-e7016b04a2ed', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e5e57-7fbc-4cb7-b553-8e7e6b5a0eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 1 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Volume volume-d999e9bb-db37-4a99-8355-e7016b04a2ed (d999e9bb-db37-4a99-8355-e7016b04a2ed): created successfully
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0e5e57-7fbc-4cb7-b553-8e7e6b5a0eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Flow 'volume_create_manager' (ed4ea8d4-1055-43a5-bb4c-b32872609149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9dedc153-16f9-4201-800a-8612849a1c9c tempest-CreateVolumesFromImageTest-991237026 None] Created volume successfully.
Sep 16 22:09:18 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b 1073741824" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:18 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b
Sep 16 22:09:18 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:18 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.154s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-587764745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c39f8d-3824-4b2f-859a-384dedb8b3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:14Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 58c39f8d-3824-4b2f-859a-384dedb8b3de {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:18 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de 1073741824
Sep 16 22:09:18 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e021ef7-2db2-4926-a55c-d348a5c05cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d211f71-07f8-4d1e-875b-fcc453dd0f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b (131a22ea-ded7-429d-8ea4-fce10fcc6e4b): created successfully
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d211f71-07f8-4d1e-875b-fcc453dd0f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:18 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (b366e49c-6064-4ffb-af04-0d501837abfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-93ed65c6-92b9-46da-9cdc-2ade18bb5e8c tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:19 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de 1073741824" returned: 0 in 0.437s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-d999e9bb-db37-4a99-8355-e7016b04a2ed-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:19 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de
Sep 16 22:09:19 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-d999e9bb-db37-4a99-8355-e7016b04a2ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-quobyte-d999e9bb-db37-4a99-8355-e7016b04a2ed" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-d999e9bb-db37-4a99-8355-e7016b04a2ed" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c08d6b-9e55-4dfc-aa06-28489f2033ec]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:19 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed
Sep 16 22:09:19 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:19 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.435s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-228821064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2ac7ec-765f-4408-8c75-9a627a895a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:15Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 4e2ac7ec-765f-4408-8c75-9a627a895a9d {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:19 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ba0874-2059-4308-b6f1-b85587725316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c39f8d-3824-4b2f-859a-384dedb8b3de', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:19 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d 1073741824
Sep 16 22:09:19 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f621f7-80aa-45df-9ef0-ae8b7de22cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:19 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-58c39f8d-3824-4b2f-859a-384dedb8b3de (58c39f8d-3824-4b2f-859a-384dedb8b3de): created successfully
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f621f7-80aa-45df-9ef0-ae8b7de22cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (6617eaa6-0860-4a6e-a5a3-ec95b9a01554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:19 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e6a0d7a9-3c33-4e37-99b2-5e4e545a7ced tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:19 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:19 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed
Sep 16 22:09:19 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:19 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d 1073741824" returned: 0 in 0.483s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:19 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-d999e9bb-db37-4a99-8355-e7016b04a2ed" returned: 0 in 0.278s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-d999e9bb-db37-4a99-8355-e7016b04a2ed" released by "delete_volume" :: held 0.721s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack sudo[104924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d
Sep 16 22:09:20 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Created reservations ['c5998595-1005-4471-8512-7f2e49c6208d', 'eebc800f-bdd5-4b13-80ce-e78cf27d7288', 'ede13e92-03b9-4366-97cc-57874cb574a7', '9f7fee82-296a-4ecb-986e-6c03bbefbe59'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:20 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:20 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.884s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61987531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418f583d-4cb6-486e-b979-d7e9c46605f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:15Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 418f583d-4cb6-486e-b979-d7e9c46605f9 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:20 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c869f4c-a4c3-4dc1-89e5-cf79b1861768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:20 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 1073741824
Sep 16 22:09:20 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ce73ea-7e95-4ec2-a9af-e2364963fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:20 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d (4e2ac7ec-765f-4408-8c75-9a627a895a9d): created successfully
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ce73ea-7e95-4ec2-a9af-e2364963fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (a0bdd405-5b17-4ef5-b308-31eecc3a08f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-853c1a03-99b9-4835-910c-2a88025c2082 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-01d2b45c-107e-4f83-a426-5c81ed33590c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-01d2b45c-107e-4f83-a426-5c81ed33590c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:20 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Deleted volume successfully.
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1d646564-3bb3-44c1-b97a-661a0bd69413 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-d999e9bb-db37-4a99-8355-e7016b04a2ed-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-quobyte-01d2b45c-107e-4f83-a426-5c81ed33590c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-01d2b45c-107e-4f83-a426-5c81ed33590c" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff01095a-7379-4b26-9013-73ca9957c6a0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c
Sep 16 22:09:20 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:20 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 1073741824" returned: 0 in 0.492s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9
Sep 16 22:09:20 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:20 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c" returned: 0 in 0.402s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:20 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c
Sep 16 22:09:20 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:21 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9" returned: 0 in 0.266s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.154s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737706743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a04e0-dca8-4055-929c-5a30bd4f8209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c45a1d483e43c1a0cadccea6f6e47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:16Z,use_quota=True,user_id='91bac4fd830d4fad91569ba9d316ae36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Creating volume 309a04e0-dca8-4055-929c-5a30bd4f8209 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae832d-41f4-4c9a-9c21-a2d07d0a1610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418f583d-4cb6-486e-b979-d7e9c46605f9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:21 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 1073741824
Sep 16 22:09:21 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f98aba0-e645-4398-a2be-03bd03caec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-418f583d-4cb6-486e-b979-d7e9c46605f9 (418f583d-4cb6-486e-b979-d7e9c46605f9): created successfully
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f98aba0-e645-4398-a2be-03bd03caec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (e009da0a-5df3-46aa-b6d9-a1f414fd5296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d0da6519-afd6-4deb-8d83-bccaa7b46c9a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:21 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-01d2b45c-107e-4f83-a426-5c81ed33590c" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-01d2b45c-107e-4f83-a426-5c81ed33590c" released by "delete_volume" :: held 0.745s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Created reservations ['a32c298b-31ab-4075-bb7d-4961fa776c23', 'abc977cd-9119-4ea7-ad4d-204e5abb3e76', '0be2d6cc-ea07-4712-af13-12169e9b1b36', 'bcde38e2-37ee-43cf-9dd2-86bfd0627349'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:21 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:21 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-05229983-0941-4dba-88ed-58d87da3c54f-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:21 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 1073741824" returned: 0 in 0.482s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-05229983-0941-4dba-88ed-58d87da3c54f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:21 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.307s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:21 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209
Sep 16 22:09:21 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Deleted volume successfully.
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-quobyte-05229983-0941-4dba-88ed-58d87da3c54f" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-05229983-0941-4dba-88ed-58d87da3c54f" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d7b773cc-997e-4b94-a9f2-d9052b855818 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-01d2b45c-107e-4f83-a426-5c81ed33590c-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc67aa8-fdae-4177-958d-278531b80279]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:21 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f
Sep 16 22:09:21 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:21 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.991s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038eec6d-72b1-4a1a-a090-9652fd991bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309a04e0-dca8-4055-929c-5a30bd4f8209', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0606fab0-d986-4ed6-8ce5-df2dc584760a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Creating offline snapshot d2976fe3-979d-4dc7-ac11-ec12b69ee8aa of volume a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Volume volume-309a04e0-dca8-4055-929c-5a30bd4f8209 (309a04e0-dca8-4055-929c-5a30bd4f8209): created successfully
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0606fab0-d986-4ed6-8ce5-df2dc584760a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Flow 'volume_create_manager' (c6e3b826-6589-4f0b-b26c-9c4ef2694128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6bf42-207e-4627-9eee-757a286c2a97]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-252463ad-fe43-446e-8c7d-f51be43c62bc tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created volume successfully.
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:22 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:22 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f
Sep 16 22:09:22 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-309a04e0-dca8-4055-929c-5a30bd4f8209-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:22 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.444s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-309a04e0-dca8-4055-929c-5a30bd4f8209-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:22 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-05229983-0941-4dba-88ed-58d87da3c54f" returned: 0 in 0.304s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:22 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa 1G
Sep 16 22:09:22 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-05229983-0941-4dba-88ed-58d87da3c54f" released by "delete_volume" :: held 0.748s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-309a04e0-dca8-4055-929c-5a30bd4f8209" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-309a04e0-dca8-4055-929c-5a30bd4f8209" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e809d87-f454-4278-8f77-d3b9e383373b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Created reservations ['770ecadd-93db-4ff9-853b-91120d4ddb18', 'd60c3197-7486-4aaa-b2ac-1d4929846054', '5855896b-b764-4b9b-b2b6-112ae3ff7c86', '7a92bb78-56a0-4168-a94f-287f4052512b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209
Sep 16 22:09:22 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:22 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-484c025e-f228-4fee-b58a-0052db147987-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-484c025e-f228-4fee-b58a-0052db147987-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:22 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-quobyte-484c025e-f228-4fee-b58a-0052db147987" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa 1G" returned: 0 in 0.524s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-484c025e-f228-4fee-b58a-0052db147987" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:22 devstack sudo[104990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:22 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:22 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99f27fa-892f-408e-bc11-78d4b6a73e83]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209" returned: 0 in 0.485s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.411s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Deleted volume successfully.
Sep 16 22:09:23 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209
Sep 16 22:09:23 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d93c2f82-a680-45ee-9edc-ef3ba3bf030f tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-05229983-0941-4dba-88ed-58d87da3c54f-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:23 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987
Sep 16 22:09:23 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.311s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa is being set with open permissions: ugo+rw
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:23 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-309a04e0-dca8-4055-929c-5a30bd4f8209" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-309a04e0-dca8-4055-929c-5a30bd4f8209" released by "delete_volume" :: held 0.836s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['fe1e421b-ecc0-4194-8707-900ffff9a4ec', '1ccb9f10-3dd8-4485-8871-551f43f1cd45', '509e3551-d09b-437f-9101-45d8ae03cc83', '418a0864-4458-4c86-a0c5-77ec4c61b67d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:23 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987" returned: 0 in 0.439s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:23 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987
Sep 16 22:09:23 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:23 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-418f583d-4cb6-486e-b979-d7e9c46605f9-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-418f583d-4cb6-486e-b979-d7e9c46605f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-418f583d-4cb6-486e-b979-d7e9c46605f9" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:23 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-418f583d-4cb6-486e-b979-d7e9c46605f9" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02bf779-bb6c-4188-bea6-f3df709d96d1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-484c025e-f228-4fee-b58a-0052db147987" returned: 0 in 0.316s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-484c025e-f228-4fee-b58a-0052db147987" released by "delete_volume" :: held 0.821s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.297s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:23 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3fc86b7a-1b8e-4b76-8835-9e11d63a6564 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-309a04e0-dca8-4055-929c-5a30bd4f8209-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:23 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9
Sep 16 22:09:23 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Created reservations ['a8874838-c73e-4259-a6f1-79a906e6a9be', '39453b85-4d26-4a59-9109-55b9defb37ed', 'd2c2dcdd-af4d-4f4f-ad39-9fe1689bffa0', 'd42206a7-ee80-4f24-b18e-68cafa2821a9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:23 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info" returned: 0 in 0.322s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:23 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info is being set with open permissions: ugo+rw
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:23 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:23 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info
Sep 16 22:09:23 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-a2e6b14a-c222-45e8-a238-78e6e0929a67-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-a2e6b14a-c222-45e8-a238-78e6e0929a67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "cinder-quobyte-a2e6b14a-c222-45e8-a238-78e6e0929a67" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-a2e6b14a-c222-45e8-a238-78e6e0929a67" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1c372-cdc0-4198-b90a-d9cdadae8814]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9" returned: 0 in 0.481s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9
Sep 16 22:09:24 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.318s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Deleted volume successfully.
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-182c3b48-eb39-497f-9a48-cd6ca2a5d810 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-484c025e-f228-4fee-b58a-0052db147987-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:24 devstack sudo[105025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67
Sep 16 22:09:24 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.info" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.246s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c4b5c7060430e8aa22503f523fa0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:16Z,use_quota=True,user_id='d36fd0102d6b462f8db5d55a0e4074c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9b3f0cf-4eab-468b-932a-61094f3b7343),volume_type_id=c9b3f0cf-4eab-468b-932a-61094f3b7343)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Creating volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:24 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1073741824
Sep 16 22:09:24 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7cd6fb74-40df-496a-acff-a87324b56bab tempest-VolumeDependencyTests-515976011 None] Create snapshot completed successfully
Sep 16 22:09:24 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-418f583d-4cb6-486e-b979-d7e9c46605f9" returned: 0 in 0.278s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-418f583d-4cb6-486e-b979-d7e9c46605f9" released by "delete_volume" :: held 0.807s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['117e55e8-3094-4267-a46c-5a8404564efc', '8426daa5-f4b5-42c7-905f-d0de1885ad3f', '6a76678c-8b28-4b3d-9c8b-1251dd803fe6', '6b8edb9d-23aa-4b01-846a-1ff76ea0a1c0'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:24 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67" returned: 0 in 0.482s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:24 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67
Sep 16 22:09:24 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-4e2ac7ec-765f-4408-8c75-9a627a895a9d-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-4e2ac7ec-765f-4408-8c75-9a627a895a9d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-4e2ac7ec-765f-4408-8c75-9a627a895a9d" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-4e2ac7ec-765f-4408-8c75-9a627a895a9d" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:24 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1073741824" returned: 0 in 0.539s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[878e4a0c-0c79-4f6d-af14-4042924e48cb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.293s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ed079aea-8a89-463f-9a43-af2412b7b0c2 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-418f583d-4cb6-486e-b979-d7e9c46605f9-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:24 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3
Sep 16 22:09:24 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:24 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a2e6b14a-c222-45e8-a238-78e6e0929a67" returned: 0 in 0.355s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-quobyte-a2e6b14a-c222-45e8-a238-78e6e0929a67" released by "delete_volume" :: held 0.886s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:25 devstack sudo[105046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d
Sep 16 22:09:25 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Created reservations ['ff74b709-2462-4a63-b556-09433b1c667c', '5dc29769-d586-4873-913e-5b5d17dd7c0a', '2ff200ff-3af9-4d84-8c00-835b028e1f70', '2e2e1bd1-ae3d-4e2e-8ddf-5129e7103cbe'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:25 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:25 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:25 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" returned: 0 in 0.314s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Attempting download of 1dba007a-25cc-4549-bf24-1cacf63964e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}])) to volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:09:25 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d" returned: 0 in 0.453s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:25 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d
Sep 16 22:09:25 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5ef18-0d85-4ab6-82f2-feb967f026f0]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:25 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.442s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Deleted volume successfully.
Sep 16 22:09:25 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf
Sep 16 22:09:25 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8d7cd97a-dc76-40f1-84d7-6d9a71fa7b13 tempest-CreateVolumesFromImageTest-991237026 None] Lock "cinder-a2e6b14a-c222-45e8-a238-78e6e0929a67-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:25 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4e2ac7ec-765f-4408-8c75-9a627a895a9d" returned: 0 in 0.317s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-4e2ac7ec-765f-4408-8c75-9a627a895a9d" released by "delete_volume" :: held 0.831s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['927a804f-1734-43c5-a242-84fbfd272e8a', 'b6b10c69-86d5-4a18-be5f-d2559338405f', '63c45308-5fe5-472a-9099-c90780405328', 'faaa637a-daea-49b1-81ab-b6159e13eec9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:25 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf" returned: 0 in 0.525s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:25 devstack sudo[105065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:25 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:25 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-58c39f8d-3824-4b2f-859a-384dedb8b3de-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-58c39f8d-3824-4b2f-859a-384dedb8b3de-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:26 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf
Sep 16 22:09:26 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-58c39f8d-3824-4b2f-859a-384dedb8b3de" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Flow 'volume_create_manager' (f69d03d0-8444-4ae1-8fa3-05dfcbc09841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab079cdc-7a00-4bfc-ac7c-e05e2e37b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-58c39f8d-3824-4b2f-859a-384dedb8b3de" acquired by "delete_volume" :: waited 0.070s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab079cdc-7a00-4bfc-ac7c-e05e2e37b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-795371853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc252d09-d173-4478-a11c-3fb96dd2c5df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fca244b639a492a92ac3389c544bd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2976fe3-979d-4dc7-ac11-ec12b69ee8aa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:26Z,use_quota=True,user_id='b2356b8ae0f546988198349d3ff1d719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da8d1c7-858d-41f1-bfd1-a066a3d36a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da8d1c7-858d-41f1-bfd1-a066a3d36a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:26 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71135c8-5d1d-45b3-8f36-79d71cc0b1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71135c8-5d1d-45b3-8f36-79d71cc0b1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc252d09-d173-4478-a11c-3fb96dd2c5df', 'volume_name': 'volume-bc252d09-d173-4478-a11c-3fb96dd2c5df', 'volume_size': 1, 'snapshot_id': 'd2976fe3-979d-4dc7-ac11-ec12b69ee8aa'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3a953a-13d5-4f64-959c-13c7ea5bcaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3a953a-13d5-4f64-959c-13c7ea5bcaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2ef1c-5e35-439d-a092-764df854029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:26 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Volume bc252d09-d173-4478-a11c-3fb96dd2c5df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc252d09-d173-4478-a11c-3fb96dd2c5df', 'volume_size': 1, 'snapshot_id': 'd2976fe3-979d-4dc7-ac11-ec12b69ee8aa'}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[36013674-362f-4d4a-87be-0cc9259857c7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.473s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-bc252d09-d173-4478-a11c-3fb96dd2c5df" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-bc252d09-d173-4478-a11c-3fb96dd2c5df" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Creating volume bc252d09-d173-4478-a11c-3fb96dd2c5df from snapshot d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:26 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-af7338db-2d37-4134-a3e0-29d64964b5aa tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-4e2ac7ec-765f-4408-8c75-9a627a895a9d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf" returned: 1 in 0.485s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1dba007a-25cc-4549-bf24-1cacf63964e3_16vyoamf' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2094bd6-cc2f-481a-b78c-780f512dc785]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] snapshot: d2976fe3-979d-4dc7-ac11-ec12b69ee8aa, volume: bc252d09-d173-4478-a11c-3fb96dd2c5df,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:09:26 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de
Sep 16 22:09:26 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08d6c42-30e2-44a4-a2ef-778f349df8b7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:26 devstack sudo[105073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:26 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:26 devstack sudo[105075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:26 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:26 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de" returned: 0 in 0.517s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:26 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:26 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de
Sep 16 22:09:26 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.508s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:09:27 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD
Sep 16 22:09:27 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a22c6-e900-4b46-84c2-014af13ecbca]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:27 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-58c39f8d-3824-4b2f-859a-384dedb8b3de" returned: 0 in 0.330s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:27 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-58c39f8d-3824-4b2f-859a-384dedb8b3de" released by "delete_volume" :: held 0.968s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['df4b6889-4bbb-467e-88f3-30673619e471', '8b320786-e1b7-4ded-a8ca-9a38f273f243', '83541b40-2cec-471d-81a4-8602d17eca3a', '119e03c4-9200-493e-90ce-97f712f6b4ec'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:27 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] 1dba007a-25cc-4549-bf24-1cacf63964e3 was raw, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:27 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3
Sep 16 22:09:27 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:27 devstack sudo[105100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:27 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.456s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:27 devstack sudo[105104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df
Sep 16 22:09:27 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:27 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.281s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-ff448ece-de0f-49b0-9644-e5640c405c48 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-58c39f8d-3824-4b2f-859a-384dedb8b3de-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:27 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" returned: 0 in 0.589s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1dba007a-25cc-4549-bf24-1cacf63964e3_n_kif0_9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:09:27 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 22:09:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:27 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1G
Sep 16 22:09:27 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-131a22ea-ded7-429d-8ea4-fce10fcc6e4b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-131a22ea-ded7-429d-8ea4-fce10fcc6e4b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:28 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 1G" returned: 0 in 0.637s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Downloaded image 1dba007a-25cc-4549-bf24-1cacf63964e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}])) to volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Temporary image 1dba007a-25cc-4549-bf24-1cacf63964e3 for user d36fd0102d6b462f8db5d55a0e4074c3 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Marking volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e0515e-518c-475e-b8bd-23e9919842ca]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Copying metadata from image 1dba007a-25cc-4549-bf24-1cacf63964e3 to 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Creating volume glance metadata for volume 4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 backed by image 1dba007a-25cc-4549-bf24-1cacf63964e3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4eea937da44b9be87a2af0fc70238563', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0de353-194b-49f1-94d3-6666c53d6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3', 'volume_size': 1, 'image_id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1dba007a-25cc-4549-bf24-1cacf63964e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eea937da44b9be87a2af0fc70238563', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '516c4b5c7060430e8aa22503f523fa0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '66bcd16e99e56861cfa73213edc82983db0f94c50ebd482a9b289840f69c9fe2cc4027f5d3e04a7a943774332b2494fd49d9d8f9174133bf2dd5e7ecacf32c48', 'id': '1dba007a-25cc-4549-bf24-1cacf63964e3', 'created_at': datetime.datetime(2026, 9, 16, 20, 9, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1dba007a-25cc-4549-bf24-1cacf63964e3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82aff3fbc0>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105e8185-f15f-413b-8784-45b98b28d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:28 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Volume volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 (4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3): created successfully
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105e8185-f15f-413b-8784-45b98b28d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Flow 'volume_create_manager' (1e78dafd-e2df-41f6-addb-36887c4e07f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bbd69fbc-2692-4544-9bde-01f1ba55d87c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Created volume successfully.
Sep 16 22:09:28 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b
Sep 16 22:09:28 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Acquiring lock "cinder-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "cinder-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Acquiring lock "cinder-quobyte-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "cinder-quobyte-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" acquired by "delete_volume" :: waited 0.060s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93a9f8-01c3-489e-ba87-fcfd42f15986]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:29 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3
Sep 16 22:09:29 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:29 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" returned: 0 in 1.020s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:29 devstack sudo[105135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b
Sep 16 22:09:29 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (c5a401a1-ee60-4d69-9c80-1d4b22051a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:30 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff1db94-f40e-4cb8-87bc-40fb638b36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" returned: 0 in 0.501s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:30 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" returned: 0 in 0.803s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-131a22ea-ded7-429d-8ea4-fce10fcc6e4b" released by "delete_volume" :: held 1.633s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff1db94-f40e-4cb8-87bc-40fb638b36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409792654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97e1800-a8e3-473c-b179-aefd7e818184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:30Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6113db5-2e32-4882-9ad0-49a97c4b9801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:30 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3
Sep 16 22:09:30 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6113db5-2e32-4882-9ad0-49a97c4b9801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c030b5d-8140-4d42-86ac-dfa16f7561b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c030b5d-8140-4d42-86ac-dfa16f7561b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97e1800-a8e3-473c-b179-aefd7e818184', 'volume_name': 'volume-b97e1800-a8e3-473c-b179-aefd7e818184', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2c9f12-bd7e-475a-bbe9-aecf4d49f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2c9f12-bd7e-475a-bbe9-aecf4d49f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5899d1f0-c23f-4838-b246-93b3aa869ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:30 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume b97e1800-a8e3-473c-b179-aefd7e818184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97e1800-a8e3-473c-b179-aefd7e818184', 'volume_size': 1}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['22ed288e-3028-48e1-93bc-8c399562d32a', '327de533-5136-4eaf-9d16-b56c9bf1bcfd', 'fed5ed53-f779-4901-912a-2c0ed9058d84', '88a1343a-33c0-4a0c-ba84-5343fabaaf79'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:30 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:30 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:30 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" returned: 0 in 0.545s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "cinder-quobyte-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3" released by "delete_volume" :: held 1.450s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Created reservations ['ff6727ef-896d-41e5-af99-1090abeb3365', '37dea644-efdd-4da7-8e74-226d706cea02', '154aaef8-da2f-4db6-af56-f7a2a98cb02b', 'c357f0c4-b74f-4ae8-97fe-e895a059936d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-8a0add91-9bd9-4130-afe4-9aa4312ea5da-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-8a0add91-9bd9-4130-afe4-9aa4312ea5da-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:30 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.588s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:30 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "cinder-quobyte-8a0add91-9bd9-4130-afe4-9aa4312ea5da" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a1a9a8f6-45d1-4915-bf3d-7f4ba377f66a tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-131a22ea-ded7-429d-8ea4-fce10fcc6e4b-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-8a0add91-9bd9-4130-afe4-9aa4312ea5da" acquired by "delete_volume" :: waited 0.055s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:31 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:31 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e41a76-6bca-49a4-8b1d-d725715b2b5f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:31 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:31 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da
Sep 16 22:09:31 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Deleted volume successfully.
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a84e19d8-2fac-4c48-8461-ebac6f89661c tempest-VolumeAndVolumeTypeFromImageTest-1988801400 None] Lock "cinder-4a312e5f-6d0c-4ee4-8a0b-b40f6299e6e3-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:31 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da" returned: 0 in 0.672s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:31 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da
Sep 16 22:09:31 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:32 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a0add91-9bd9-4130-afe4-9aa4312ea5da" returned: 0 in 0.490s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-quobyte-8a0add91-9bd9-4130-afe4-9aa4312ea5da" released by "delete_volume" :: held 1.258s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Created reservations ['650661f7-02df-4a75-9f09-490911dbbdf0', '3b79b64f-1e67-45cf-aca6-2657fdfbc844', '8ceea2ae-8216-43c2-823a-147c8a23ab37', '37b21c10-9ad4-439d-8359-fc4e96a1596f'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:32 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:32 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:33 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.484s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:33 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Deleted volume successfully.
Sep 16 22:09:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-62d05f6e-a0ed-4f05-be1b-af762c4cbf75 tempest-CreateVolumesFromSourceVolumeTest-29647261 None] Lock "cinder-8a0add91-9bd9-4130-afe4-9aa4312ea5da-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:36 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df" returned: 0 in 9.076s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:09:36 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Converted 1024.00 MB image at 112.81 MB/s
Sep 16 22:09:36 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df is being set with open permissions: ugo+rw
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:36 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df
Sep 16 22:09:36 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:36 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" released by "_copy_volume_from_snapshot" :: held 10.435s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-bc252d09-d173-4478-a11c-3fb96dd2c5df" released by "_create_volume_from_snapshot" :: held 10.547s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.582s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.742s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409792654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97e1800-a8e3-473c-b179-aefd7e818184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:30Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:36 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:36 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 1073741824
Sep 16 22:09:36 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef2ef1c-5e35-439d-a092-764df854029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc252d09-d173-4478-a11c-3fb96dd2c5df', 'volume_size': 1, 'snapshot_id': 'd2976fe3-979d-4dc7-ac11-ec12b69ee8aa'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6926462-1995-4da0-bc1f-ed1971b0f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Volume volume-bc252d09-d173-4478-a11c-3fb96dd2c5df (bc252d09-d173-4478-a11c-3fb96dd2c5df): created successfully
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6926462-1995-4da0-bc1f-ed1971b0f11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Flow 'volume_create_manager' (f69d03d0-8444-4ae1-8fa3-05dfcbc09841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-bf81bb63-1c83-4ca7-9191-6218190e0392 tempest-VolumeDependencyTests-515976011 None] Created volume successfully.
Sep 16 22:09:37 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 1073741824" returned: 0 in 0.516s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:37 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184
Sep 16 22:09:37 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:37 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184" returned: 0 in 0.281s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5899d1f0-c23f-4838-b246-93b3aa869ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97e1800-a8e3-473c-b179-aefd7e818184', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72d9491-fc76-4c97-b674-ba65b4780c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:37 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-b97e1800-a8e3-473c-b179-aefd7e818184 (b97e1800-a8e3-473c-b179-aefd7e818184): created successfully
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72d9491-fc76-4c97-b674-ba65b4780c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:37 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (c5a401a1-ee60-4d69-9c80-1d4b22051a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:37 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7fcd3ed4-7c61-4fab-a9d3-5417a8b1a745 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Flow 'volume_create_manager' (999fadc0-0975-4681-8b59-0b4ac335ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a48c37d-0b2b-4057-bb83-148501d1fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a48c37d-0b2b-4057-bb83-148501d1fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b11e981-521e-4a21-9521-1bc3d860e4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a566df7bc45a41509fd923184ffa4728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:38Z,use_quota=True,user_id='1e8b36899aad4e328d90681dd5ad331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a90d97-302e-4b64-abcb-9e99884387b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a90d97-302e-4b64-abcb-9e99884387b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e7ca13-6300-4b00-9c51-37fed6b0d214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e7ca13-6300-4b00-9c51-37fed6b0d214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b11e981-521e-4a21-9521-1bc3d860e4fb', 'volume_name': 'volume-2b11e981-521e-4a21-9521-1bc3d860e4fb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0d1ed8-d4d3-4849-96ee-f745e91fe078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0d1ed8-d4d3-4849-96ee-f745e91fe078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0c1274-28b1-4d6a-9f55-1d0366379cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:38 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Volume 2b11e981-521e-4a21-9521-1bc3d860e4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b11e981-521e-4a21-9521-1bc3d860e4fb', 'volume_size': 1}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b11e981-521e-4a21-9521-1bc3d860e4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a566df7bc45a41509fd923184ffa4728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:38Z,use_quota=True,user_id='1e8b36899aad4e328d90681dd5ad331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Creating volume 2b11e981-521e-4a21-9521-1bc3d860e4fb {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:38 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:38 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb 1073741824
Sep 16 22:09:38 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Deleting offline snapshot d2976fe3-979d-4dc7-ac11-ec12b69ee8aa of volume a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] snapshot_file for this snap is: volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a079f2-3911-4986-b8d7-f09460830c9e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:38 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:38 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:38 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb 1073741824" returned: 0 in 0.523s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:38 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.484s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:09:38 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb
Sep 16 22:09:38 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6dc8b8-1bb2-4a59-9011-eae396a8ef3f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:39 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:39 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:39 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb" returned: 0 in 0.314s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.115s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0c1274-28b1-4d6a-9f55-1d0366379cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b11e981-521e-4a21-9521-1bc3d860e4fb', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afafa617-822d-4897-b42e-d97c073b8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating offline snapshot be25a74b-0421-4929-b123-c52ab7e4c3ee of volume b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:09:39 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Volume volume-2b11e981-521e-4a21-9521-1bc3d860e4fb (2b11e981-521e-4a21-9521-1bc3d860e4fb): created successfully
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afafa617-822d-4897-b42e-d97c073b8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Flow 'volume_create_manager' (999fadc0-0975-4681-8b59-0b4ac335ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b645af-95a2-40d3-ac80-4416a8ccebda]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-503d5198-a52f-4300-a967-c2e674e9a806 tempest-CinderUnicodeTest-1304942866 None] Created volume successfully.
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-26de0e0c-60d5-4e3a-aa9d-22c2d0140d4a tempest-ProjectAdminTests-1010787406 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8547668457031, 'free_capacity_gb': 1775.8547668457031, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85936) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 22:09:39 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184
Sep 16 22:09:39 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:39 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.627s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:39 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:39 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:39 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184" returned: 0 in 0.414s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:39 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee 1G
Sep 16 22:09:39 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:39 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:39 devstack sudo[105210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa
Sep 16 22:09:39 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:40 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee 1G" returned: 0 in 0.500s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97e1800-a8e3-473c-b179-aefd7e818184 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:40 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97e1800-a8e3-473c-b179-aefd7e818184 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee
Sep 16 22:09:40 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:40 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc.d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa" released by "_delete_snapshot" :: held 1.937s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" released by "delete_snapshot" :: held 1.962s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Created reservations ['77be78ca-1cce-4ac2-a330-104b5466807d', 'f98723c3-3e27-4345-b7b1-7999f2eb2922', 'e73443bf-6e5a-47ac-a5dd-8f196c84c1c5', '7dd595ff-d64d-4933-a8b8-f9cbcf8fbcf3'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Delete snapshot completed successfully.
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-31e715d4-bc70-4da4-9294-193d9d16820a tempest-VolumeDependencyTests-515976011 None] Lock "cinder-d2976fe3-979d-4dc7-ac11-ec12b69ee8aa-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:40 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b97e1800-a8e3-473c-b179-aefd7e818184 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:40 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee is being set with open permissions: ugo+rw
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:40 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee
Sep 16 22:09:40 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:40 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee" returned: 0 in 0.303s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:40 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info
Sep 16 22:09:40 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Flow 'volume_create_manager' (a8d6fca8-9e1b-4720-9733-68cf231b7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1736ce91-3cfe-46c3-bab8-24738763398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1736ce91-3cfe-46c3-bab8-24738763398f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1735775448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f909c2-c801-483f-9efd-b6133a0bb9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a566df7bc45a41509fd923184ffa4728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:41Z,use_quota=True,user_id='1e8b36899aad4e328d90681dd5ad331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306af308-7bc5-4e0d-b377-809bfbd2719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306af308-7bc5-4e0d-b377-809bfbd2719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:40 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ed6506-9bd1-47b7-8481-48560a63cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ed6506-9bd1-47b7-8481-48560a63cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f909c2-c801-483f-9efd-b6133a0bb9b9', 'volume_name': 'volume-69f909c2-c801-483f-9efd-b6133a0bb9b9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3a241-9a92-4203-b499-7d22adbd043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3a241-9a92-4203-b499-7d22adbd043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4c231c-71be-4cab-bb1a-b3d420e21b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:41 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Volume 69f909c2-c801-483f-9efd-b6133a0bb9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f909c2-c801-483f-9efd-b6133a0bb9b9', 'volume_size': 1}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:41 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info" returned: 0 in 0.327s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:41 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info is being set with open permissions: ugo+rw
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:41 devstack sudo[105227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info
Sep 16 22:09:41 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:41 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.info" returned: 0 in 0.257s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1735775448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f909c2-c801-483f-9efd-b6133a0bb9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a566df7bc45a41509fd923184ffa4728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:41Z,use_quota=True,user_id='1e8b36899aad4e328d90681dd5ad331e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Creating volume 69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:41 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-a50ef888-20d1-42ed-b5f6-8ca0c68027fc-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:41 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 1073741824
Sep 16 22:09:41 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e02b4426-b716-4441-bb06-35f4d7bbb92b tempest-CreateVolumesFromSnapshotTest-824763280 None] Create snapshot completed successfully
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-a50ef888-20d1-42ed-b5f6-8ca0c68027fc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba14df40-3470-4740-a13f-662225a561d0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:41 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:41 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:42 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 1073741824" returned: 0 in 0.525s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:42 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.416s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:42 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9
Sep 16 22:09:42 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:42 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc
Sep 16 22:09:42 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:42 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4c231c-71be-4cab-bb1a-b3d420e21b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f909c2-c801-483f-9efd-b6133a0bb9b9', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1af40c8-888d-40d5-aea4-910aa0144a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" returned: 0 in 0.293s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-a50ef888-20d1-42ed-b5f6-8ca0c68027fc" released by "delete_volume" :: held 0.790s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Volume volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 (69f909c2-c801-483f-9efd-b6133a0bb9b9): created successfully
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1af40c8-888d-40d5-aea4-910aa0144a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Flow 'volume_create_manager' (a8d6fca8-9e1b-4720-9733-68cf231b7b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e5f53060-1acb-4505-9133-7f181d98d6dc tempest-CinderUnicodeTest-1304942866 None] Created volume successfully.
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Created reservations ['d496e66d-05d6-43e1-80a3-73ab2e834dd2', '605c5728-b155-49f7-bbd2-0bfd4e182385', 'dc5ffb07-18d7-4bb9-8f43-2ad6a833f59a', '62670a04-3ccc-43cd-aa43-59f55bfe1d10'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:42 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:42 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-bc252d09-d173-4478-a11c-3fb96dd2c5df-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-bc252d09-d173-4478-a11c-3fb96dd2c5df-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (2bdf98c9-8a88-4198-8beb-b1581bacbf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3de901d-f7fc-4946-9863-f8db35d88535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3de901d-f7fc-4946-9863-f8db35d88535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1106185247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a873afe-83d3-4ae2-b7a5-acc191b09436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:43Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2675d03-1594-44c2-9d1c-9597c2d2aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2675d03-1594-44c2-9d1c-9597c2d2aac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb86e2d1-dffe-456e-a8ac-f4195264b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb86e2d1-dffe-456e-a8ac-f4195264b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a873afe-83d3-4ae2-b7a5-acc191b09436', 'volume_name': 'volume-8a873afe-83d3-4ae2-b7a5-acc191b09436', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb160e77-4ebf-4e0f-8a76-dcc9df943436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb160e77-4ebf-4e0f-8a76-dcc9df943436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0712b5-4489-4035-812e-8a244747a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume 8a873afe-83d3-4ae2-b7a5-acc191b09436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a873afe-83d3-4ae2-b7a5-acc191b09436', 'volume_size': 1}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1106185247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a873afe-83d3-4ae2-b7a5-acc191b09436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:43Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume 8a873afe-83d3-4ae2-b7a5-acc191b09436 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:42 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" acquired by "delete_volume" :: waited 0.127s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:42 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.412s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:42 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Deleted volume successfully.
Sep 16 22:09:43 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 1073741824
Sep 16 22:09:43 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc8340-68e6-40a1-ada5-cb5608f45f1a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-67caf7c4-c756-415b-aa22-be852660ef79 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-a50ef888-20d1-42ed-b5f6-8ca0c68027fc-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:43 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df
Sep 16 22:09:43 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (a4300293-84cd-4643-a4eb-43fed9977ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93197223-dd3a-485f-bc3b-0598229854d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93197223-dd3a-485f-bc3b-0598229854d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551986920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0688bd6a-aa3c-4331-84d0-9f979301e525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:43Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269322a3-0745-4ef9-807f-6dd5b9cc72fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269322a3-0745-4ef9-807f-6dd5b9cc72fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c5b25-e839-4169-97ee-87c6ee573cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c5b25-e839-4169-97ee-87c6ee573cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0688bd6a-aa3c-4331-84d0-9f979301e525', 'volume_name': 'volume-0688bd6a-aa3c-4331-84d0-9f979301e525', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548a7db-b7fa-4a02-998a-b81b04c89435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7548a7db-b7fa-4a02-998a-b81b04c89435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cad503-3ddc-4eca-b5f5-6261d2ea48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume 0688bd6a-aa3c-4331-84d0-9f979301e525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0688bd6a-aa3c-4331-84d0-9f979301e525', 'volume_size': 1}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:43 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 1073741824" returned: 0 in 0.617s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:43 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df" returned: 0 in 0.609s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:43 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df
Sep 16 22:09:43 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:43 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436
Sep 16 22:09:43 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (88fc44cf-f202-416a-be51-3eaaa20eb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c721ea-3333-45c9-808f-2adc4c8cd0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-bc252d09-d173-4478-a11c-3fb96dd2c5df" returned: 0 in 0.286s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c721ea-3333-45c9-808f-2adc4c8cd0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-785577628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b31f9d-2ea2-44ce-a702-175655f2a20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:44Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806d2817-e01e-466e-a564-5a6a74c64a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806d2817-e01e-466e-a564-5a6a74c64a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f9489-6f37-448e-9ea5-89c8f1158b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f9489-6f37-448e-9ea5-89c8f1158b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b31f9d-2ea2-44ce-a702-175655f2a20b', 'volume_name': 'volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82795ff6-1bac-4a02-90bf-319fbdedb566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82795ff6-1bac-4a02-90bf-319fbdedb566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:43 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6e5c8b-b391-4ede-aa44-6013d8d94014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume c5b31f9d-2ea2-44ce-a702-175655f2a20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b', 'volume_size': 1}
Sep 16 22:09:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551986920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0688bd6a-aa3c-4331-84d0-9f979301e525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:43Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume 0688bd6a-aa3c-4331-84d0-9f979301e525 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:44 devstack sudo[105269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 1073741824
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-quobyte-bc252d09-d173-4478-a11c-3fb96dd2c5df" released by "delete_volume" :: held 1.049s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0712b5-4489-4035-812e-8a244747a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a873afe-83d3-4ae2-b7a5-acc191b09436', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8582e7cd-0e51-4630-9da8-ff2c249f2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 (8a873afe-83d3-4ae2-b7a5-acc191b09436): created successfully
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8582e7cd-0e51-4630-9da8-ff2c249f2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (2bdf98c9-8a88-4198-8beb-b1581bacbf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0024088f-0e17-4153-91f4-78c4037392cb tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Created reservations ['532a1552-d48a-443c-9491-9ddb9effb4a4', '6c44bcab-7fd6-4481-b2aa-4f3fe8041cdc', '5276b0bb-b859-48b1-ad7c-b42aff99b2ad', '4e0cf4f1-af1e-4c52-b2fd-833c8500251d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:44 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:44 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:44 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:44 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (e487ca30-5c8a-427b-b933-c0c7e44d776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0352bf-0dac-4365-b3a6-951c6cc3dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 1073741824" returned: 0 in 0.643s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0352bf-0dac-4365-b3a6-951c6cc3dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454605372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dada550-2ef0-46f5-bb49-b4793f389504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:44Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a169fe-a440-4e99-875e-7be6c60f82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a169fe-a440-4e99-875e-7be6c60f82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d4896-9853-4888-bad9-e349ceb86d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d4896-9853-4888-bad9-e349ceb86d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dada550-2ef0-46f5-bb49-b4793f389504', 'volume_name': 'volume-7dada550-2ef0-46f5-bb49-b4793f389504', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcccaaf1-fa22-4a8c-92e5-e1b268d66e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcccaaf1-fa22-4a8c-92e5-e1b268d66e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6cf2c4-17fe-495a-8d1f-5044332ec434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume 7dada550-2ef0-46f5-bb49-b4793f389504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dada550-2ef0-46f5-bb49-b4793f389504', 'volume_size': 1}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:44 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.424s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Deleted volume successfully.
Sep 16 22:09:44 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525
Sep 16 22:09:44 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cee38a78-d39a-4804-8a95-4e0e91c6e596 tempest-VolumeDependencyTests-515976011 None] Lock "cinder-bc252d09-d173-4478-a11c-3fb96dd2c5df-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (9f627208-c98b-498e-a45f-d5f10da81285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af3587a-0e00-474a-9171-2f58c253a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af3587a-0e00-474a-9171-2f58c253a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925126948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783c77bf-2e80-46fb-92ca-73a06222f32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:45Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6911e7-e74d-4bcc-91a8-79b8828efc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6911e7-e74d-4bcc-91a8-79b8828efc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f322ce3-91e5-42cc-a39d-104f0db470c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f322ce3-91e5-42cc-a39d-104f0db470c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783c77bf-2e80-46fb-92ca-73a06222f32a', 'volume_name': 'volume-783c77bf-2e80-46fb-92ca-73a06222f32a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e85281-77ab-4a51-a350-2ccabe2188d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e85281-77ab-4a51-a350-2ccabe2188d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf003bf-b220-4a98-8b68-0557647cb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:44 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Volume 783c77bf-2e80-46fb-92ca-73a06222f32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783c77bf-2e80-46fb-92ca-73a06222f32a', 'volume_size': 1}
Sep 16 22:09:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:45 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525" returned: 0 in 0.296s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.533s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cad503-3ddc-4eca-b5f5-6261d2ea48da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0688bd6a-aa3c-4331-84d0-9f979301e525', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095085c1-44ec-4fc9-a0f0-ce3f04d626e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Creating offline snapshot 56fbf07e-714d-4457-a81f-16fb77cfecb7 of volume 69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1cd873-2de9-4666-9011-f693e8842ba7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-0688bd6a-aa3c-4331-84d0-9f979301e525 (0688bd6a-aa3c-4331-84d0-9f979301e525): created successfully
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095085c1-44ec-4fc9-a0f0-ce3f04d626e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (a4300293-84cd-4643-a4eb-43fed9977ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (36e9569a-0d0e-42c7-a9f8-0e9985a4786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f56c88-874b-4e1c-8655-4e2bb522175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-88b0131b-453b-4c4c-ba15-232308b501a9 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f56c88-874b-4e1c-8655-4e2bb522175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713921093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c817db6a-5c56-4fa4-864a-a59022961aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:45Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36b3302-86d2-439e-ada2-70579c1e0fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36b3302-86d2-439e-ada2-70579c1e0fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfd379e-10cd-431d-98ab-d4cc88ed90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfd379e-10cd-431d-98ab-d4cc88ed90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c817db6a-5c56-4fa4-864a-a59022961aa3', 'volume_name': 'volume-c817db6a-5c56-4fa4-864a-a59022961aa3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b802a6-58f4-4555-9778-6b489bd4de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b802a6-58f4-4555-9778-6b489bd4de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32740f6-574c-4390-bd2a-d824406610d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume c817db6a-5c56-4fa4-864a-a59022961aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c817db6a-5c56-4fa4-864a-a59022961aa3', 'volume_size': 1}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:45 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9
Sep 16 22:09:45 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:45 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:45 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 1G
Sep 16 22:09:45 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:45 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 1G" returned: 0 in 0.411s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:45 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7
Sep 16 22:09:45 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:46 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7" returned: 0 in 0.347s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 is being set with open permissions: ugo+rw
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:46 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7
Sep 16 22:09:46 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:46 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:46 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info
Sep 16 22:09:46 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:46 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info" returned: 0 in 0.315s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info is being set with open permissions: ugo+rw
Sep 16 22:09:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:46 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info
Sep 16 22:09:46 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:47 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.info" returned: 0 in 0.284s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.181s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-785577628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b31f9d-2ea2-44ce-a702-175655f2a20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:44Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume c5b31f9d-2ea2-44ce-a702-175655f2a20b {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:47 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:47 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b 1073741824
Sep 16 22:09:47 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a657454f-6397-4f2a-a14f-65eabe0cf7f0 tempest-CinderUnicodeTest-1304942866 None] Create snapshot completed successfully
Sep 16 22:09:47 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b 1073741824" returned: 0 in 0.433s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:47 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b
Sep 16 22:09:47 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-56fbf07e-714d-4457-a81f-16fb77cfecb7-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-56fbf07e-714d-4457-a81f-16fb77cfecb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-quobyte-56fbf07e-714d-4457-a81f-16fb77cfecb7" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-56fbf07e-714d-4457-a81f-16fb77cfecb7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Deleting offline snapshot 56fbf07e-714d-4457-a81f-16fb77cfecb7 of volume 69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:09:47 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] snapshot_file for this snap is: volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.269s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454605372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dada550-2ef0-46f5-bb49-b4793f389504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:44Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume 7dada550-2ef0-46f5-bb49-b4793f389504 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:47 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010d84b-fa80-4825-9351-872df3cb1cbc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:48 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 1073741824
Sep 16 22:09:48 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6e5c8b-b391-4ede-aa44-6013d8d94014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce75e6e-ca25-448c-9225-cb805e809264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:48 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b (c5b31f9d-2ea2-44ce-a702-175655f2a20b): created successfully
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce75e6e-ca25-448c-9225-cb805e809264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (88fc44cf-f202-416a-be51-3eaaa20eb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-30394579-581e-40de-996c-f2c1a40739e7 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:48 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7
Sep 16 22:09:48 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f909c2-c801-483f-9efd-b6133a0bb9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e6884-c44b-439c-833e-385956b4c0f9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:48 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 1073741824" returned: 0 in 0.553s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:48 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9
Sep 16 22:09:48 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504
Sep 16 22:09:48 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:48 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9" returned: 0 in 0.398s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.880s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925126948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783c77bf-2e80-46fb-92ca-73a06222f32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:45Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Creating volume 783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:48 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6cf2c4-17fe-495a-8d1f-5044332ec434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dada550-2ef0-46f5-bb49-b4793f389504', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:48 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a 1073741824
Sep 16 22:09:48 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7
Sep 16 22:09:48 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb580056-49a5-4fa0-9961-e0e61dc20dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:48 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-7dada550-2ef0-46f5-bb49-b4793f389504 (7dada550-2ef0-46f5-bb49-b4793f389504): created successfully
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb580056-49a5-4fa0-9961-e0e61dc20dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:48 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (e487ca30-5c8a-427b-b933-c0c7e44d776e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:48 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-721a14eb-31d6-492d-857c-8e7476f579ce tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:49 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:49 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7
Sep 16 22:09:49 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:49 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a 1073741824" returned: 0 in 0.514s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:49 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a
Sep 16 22:09:49 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:49 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9.56fbf07e-714d-4457-a81f-16fb77cfecb7" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-56fbf07e-714d-4457-a81f-16fb77cfecb7" released by "_delete_snapshot" :: held 1.669s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" released by "delete_snapshot" :: held 1.697s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Created reservations ['fc1f49e1-8e05-4422-b9a3-3a9c79b6f89e', '0751bc9d-6311-4e80-bac0-068e5c5e6d64', 'b74c9df6-63a3-4a2e-accb-a6eae31fcca7', '7d38f04c-92fc-4a19-b27e-7b2a59cacae8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:49 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.515s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713921093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c817db6a-5c56-4fa4-864a-a59022961aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312bcee3013f422c8f4770663214f39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:09:45Z,use_quota=True,user_id='1e8efb0ae8724e18b62044dff6f1225a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Creating volume c817db6a-5c56-4fa4-864a-a59022961aa3 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:49 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:49 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 1073741824
Sep 16 22:09:49 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf003bf-b220-4a98-8b68-0557647cb91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783c77bf-2e80-46fb-92ca-73a06222f32a', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f67a8f4-f2a1-45e4-9a26-66d869fd803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Delete snapshot completed successfully.
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1c860651-b690-4980-a417-f3164840fe28 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-56fbf07e-714d-4457-a81f-16fb77cfecb7-delete_snapshot" released by "delete_snapshot" :: held 1.916s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:49 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Volume volume-783c77bf-2e80-46fb-92ca-73a06222f32a (783c77bf-2e80-46fb-92ca-73a06222f32a): created successfully
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f67a8f4-f2a1-45e4-9a26-66d869fd803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:49 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (9f627208-c98b-498e-a45f-d5f10da81285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b80d40a2-14ae-4bbe-9785-6ae4a5e97cd9 tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-69f909c2-c801-483f-9efd-b6133a0bb9b9-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-69f909c2-c801-483f-9efd-b6133a0bb9b9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca1cdd0-a837-4dfa-b8c2-5ece86006316]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:50 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 1073741824" returned: 0 in 0.561s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:50 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9
Sep 16 22:09:50 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:50 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3
Sep 16 22:09:50 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:50 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:50 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3" returned: 0 in 0.300s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:50 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9
Sep 16 22:09:50 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32740f6-574c-4390-bd2a-d824406610d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c817db6a-5c56-4fa4-864a-a59022961aa3', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5a15b6-f5f8-4455-90c4-1e0939f7993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:50 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Volume volume-c817db6a-5c56-4fa4-864a-a59022961aa3 (c817db6a-5c56-4fa4-864a-a59022961aa3): created successfully
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca5a15b6-f5f8-4455-90c4-1e0939f7993c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Flow 'volume_create_manager' (36e9569a-0d0e-42c7-a9f8-0e9985a4786e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:50 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d96bb2fa-4b75-4bf0-997c-ab1ebeca796c tempest-CreateVolumesFromSnapshotTest-824763280 None] Created volume successfully.
Sep 16 22:09:50 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-69f909c2-c801-483f-9efd-b6133a0bb9b9" returned: 0 in 0.284s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-69f909c2-c801-483f-9efd-b6133a0bb9b9" released by "delete_volume" :: held 0.794s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:50 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Created reservations ['f45f5de8-f756-4d6e-8411-2084cbda9365', 'ea83816d-4dbf-4ca9-8c38-b923d074a697', '94e7babe-40f5-4011-a126-0360fdf3aec8', '41e98d4d-84df-4f10-a0bd-f63a375f2b30'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:51 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:51 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-2b11e981-521e-4a21-9521-1bc3d860e4fb-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-2b11e981-521e-4a21-9521-1bc3d860e4fb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "cinder-quobyte-2b11e981-521e-4a21-9521-1bc3d860e4fb" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:51 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.305s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Deleted volume successfully.
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-2b11e981-521e-4a21-9521-1bc3d860e4fb" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ed8c8-d62d-4f2c-8b6f-f02a2d5d48a1]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-fe035de3-b3d1-4528-863a-1b7c039b312b tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-69f909c2-c801-483f-9efd-b6133a0bb9b9-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 870af628-abf5-4fbc-9a3f-7294fbde4b80 of volume 783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c93889-a07c-4771-b9b2-150c3c87aa21]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:51 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb
Sep 16 22:09:51 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:51 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a
Sep 16 22:09:51 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-c817db6a-5c56-4fa4-864a-a59022961aa3-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-c817db6a-5c56-4fa4-864a-a59022961aa3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-c817db6a-5c56-4fa4-864a-a59022961aa3" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-c817db6a-5c56-4fa4-864a-a59022961aa3" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a1b21-6565-4171-93fe-be2dad89006b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:51 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb" returned: 0 in 0.496s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:51 devstack sudo[105425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb
Sep 16 22:09:51 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:51 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3
Sep 16 22:09:51 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a" returned: 0 in 0.499s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 1G
Sep 16 22:09:52 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-2b11e981-521e-4a21-9521-1bc3d860e4fb" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-quobyte-2b11e981-521e-4a21-9521-1bc3d860e4fb" released by "delete_volume" :: held 0.880s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:52 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3" returned: 0 in 0.409s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3
Sep 16 22:09:52 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Created reservations ['f4f20118-12c6-43e5-acbb-d2f42a7066c5', '51b4d0e4-1738-40f8-ad91-9382e9c8e2fe', '014dba0a-a442-48c0-8e16-62cdeb1314f3', 'c8f61241-9afe-4add-854e-55b41158bc95'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:52 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 1G" returned: 0 in 0.539s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c77bf-2e80-46fb-92ca-73a06222f32a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c77bf-2e80-46fb-92ca-73a06222f32a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80
Sep 16 22:09:52 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c817db6a-5c56-4fa4-864a-a59022961aa3" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-c817db6a-5c56-4fa4-864a-a59022961aa3" released by "delete_volume" :: held 0.838s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['61dae702-5459-4059-b23f-a14e76d90be6', '5aa63dfd-d93c-4d30-9489-d5833cfe88c6', '0fb5a3f3-b488-400e-9139-5017b1ab0f4b', 'bb60ed9a-044f-4331-8e89-d41e5d0cb91f'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:52 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.374s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Deleted volume successfully.
Sep 16 22:09:52 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:52 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4c008776-85b4-4e12-8d55-923473330ba6 tempest-CinderUnicodeTest-1304942866 None] Lock "cinder-2b11e981-521e-4a21-9521-1bc3d860e4fb-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:52 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-783c77bf-2e80-46fb-92ca-73a06222f32a -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80" returned: 0 in 0.357s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:52 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 is being set with open permissions: ugo+rw
Sep 16 22:09:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:52 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80
Sep 16 22:09:52 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-7dada550-2ef0-46f5-bb49-b4793f389504-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-7dada550-2ef0-46f5-bb49-b4793f389504-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-7dada550-2ef0-46f5-bb49-b4793f389504" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-7dada550-2ef0-46f5-bb49-b4793f389504" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:53 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.307s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abfe766-aa8d-4817-83ee-39d064464cbb]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3c1ca17-270d-47c7-8bd3-227822d8bcf8 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-c817db6a-5c56-4fa4-864a-a59022961aa3-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:53 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80" returned: 0 in 0.338s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504
Sep 16 22:09:53 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:53 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info
Sep 16 22:09:53 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:53 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504" returned: 0 in 0.417s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:53 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info" returned: 0 in 0.297s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info is being set with open permissions: ugo+rw
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:53 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504
Sep 16 22:09:53 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:53 devstack sudo[105470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info
Sep 16 22:09:53 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:53 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-7dada550-2ef0-46f5-bb49-b4793f389504" returned: 0 in 0.290s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-7dada550-2ef0-46f5-bb49-b4793f389504" released by "delete_volume" :: held 0.772s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:53 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.info" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3b71536b-9578-4620-b2c9-e1f7e5b22f67 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['20704500-a483-49c5-ac5d-236e04b6fa31', '7d768a7f-e244-463e-b517-fff274d77b56', 'b3ca978d-4ea5-4de9-b85a-5880d39f2579', '6f830d27-ba76-4009-91d4-15155887773a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:54 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:54 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-c5b31f9d-2ea2-44ce-a702-175655f2a20b-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-c5b31f9d-2ea2-44ce-a702-175655f2a20b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-c5b31f9d-2ea2-44ce-a702-175655f2a20b" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-c5b31f9d-2ea2-44ce-a702-175655f2a20b" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b765b2-c76b-46a0-85af-3b9a8e0725f7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:54 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.302s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-18deca7e-552b-401d-b2b1-df86d15e6124 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-7dada550-2ef0-46f5-bb49-b4793f389504-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:54 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b
Sep 16 22:09:54 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-870af628-abf5-4fbc-9a3f-7294fbde4b80-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-870af628-abf5-4fbc-9a3f-7294fbde4b80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-870af628-abf5-4fbc-9a3f-7294fbde4b80" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-870af628-abf5-4fbc-9a3f-7294fbde4b80" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 870af628-abf5-4fbc-9a3f-7294fbde4b80 of volume 783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:09:54 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b" returned: 0 in 0.472s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc65913c-40cb-49a6-84d7-88c9cf41b131]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:54 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b
Sep 16 22:09:54 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:54 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80
Sep 16 22:09:54 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:55 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-c5b31f9d-2ea2-44ce-a702-175655f2a20b" returned: 0 in 0.282s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-c5b31f9d-2ea2-44ce-a702-175655f2a20b" released by "delete_volume" :: held 0.812s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['355cb8c7-5531-4995-96c8-35fe2fd6a39f', 'df66b05f-d45c-4a37-86af-2274edfb1579', '0aee28c9-2c69-402b-a397-91599895714e', '73ac3385-a659-4ad5-99ef-522552b7eebd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:55 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80" returned: 0 in 0.466s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-783c77bf-2e80-46fb-92ca-73a06222f32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:09:55 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:55 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[90803ea7-5a97-4030-932d-8a08dbcbc987]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-0688bd6a-aa3c-4331-84d0-9f979301e525-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-0688bd6a-aa3c-4331-84d0-9f979301e525-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-0688bd6a-aa3c-4331-84d0-9f979301e525" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-0688bd6a-aa3c-4331-84d0-9f979301e525" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:55 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a
Sep 16 22:09:55 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee602546-5e75-4c3a-903d-fcb51f951f6e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:55 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.354s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a2fa77ae-2ec6-47f3-a280-1f2f9aec0ed0 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-c5b31f9d-2ea2-44ce-a702-175655f2a20b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:55 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525
Sep 16 22:09:55 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:55 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a" returned: 0 in 0.596s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:55 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80
Sep 16 22:09:55 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:56 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525" returned: 0 in 0.453s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:56 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525
Sep 16 22:09:56 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:56 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0688bd6a-aa3c-4331-84d0-9f979301e525" returned: 0 in 0.291s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-0688bd6a-aa3c-4331-84d0-9f979301e525" released by "delete_volume" :: held 0.813s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:56 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80" returned: 0 in 0.451s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['a1882cfc-1834-4309-ad31-928525f89bad', '3530a6aa-d28e-4bd1-9104-060c1e262148', '8ca7639d-7c94-446e-b0dc-2637f2c1b424', '49556874-7c10-4d40-a918-a4aaaea1451b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:56 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80
Sep 16 22:09:56 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:56 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:56 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-8a873afe-83d3-4ae2-b7a5-acc191b09436-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-8a873afe-83d3-4ae2-b7a5-acc191b09436-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-8a873afe-83d3-4ae2-b7a5-acc191b09436" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:56 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a.870af628-abf5-4fbc-9a3f-7294fbde4b80" returned: 0 in 0.415s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-8a873afe-83d3-4ae2-b7a5-acc191b09436" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3731d83a-caac-44bf-bbef-64415946e91e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-870af628-abf5-4fbc-9a3f-7294fbde4b80" released by "_delete_snapshot" :: held 2.134s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" released by "delete_snapshot" :: held 2.171s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:56 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.454s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:56 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Created reservations ['903de100-9748-4a2c-9a32-2a66421cf55f', '0a9da65b-aef0-478c-bcce-44044e7aedad', 'bdf2c29c-ce0a-4727-9458-74eee41a7fb0', '150c06f5-ecf2-4916-b5cf-d12a2c5ba703'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8f8567cb-cca1-46ca-acdf-d05a0dba294f tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-0688bd6a-aa3c-4331-84d0-9f979301e525-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:57 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436
Sep 16 22:09:57 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-b3f656a8-4820-4e99-b0e8-e84c32f717ec tempest-ProjectMemberTests-2129052031 None] Lock "cinder-870af628-abf5-4fbc-9a3f-7294fbde4b80-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:57 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436" returned: 0 in 0.415s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:57 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436
Sep 16 22:09:57 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:57 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8a873afe-83d3-4ae2-b7a5-acc191b09436" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-8a873afe-83d3-4ae2-b7a5-acc191b09436" released by "delete_volume" :: held 0.728s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['b63835dd-5919-4bfd-a876-fbcd9add4510', '78d791e6-1375-426c-ad72-b069afc594c6', 'c9c67eda-6b23-49cf-83cd-638c0bf858a3', '37ed7684-b0f7-470c-ad54-0445e8b885f9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:57 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:57 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-be25a74b-0421-4929-b123-c52ab7e4c3ee-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:57 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.273s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-be25a74b-0421-4929-b123-c52ab7e4c3ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-be25a74b-0421-4929-b123-c52ab7e4c3ee" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9295968e-1678-45fe-b3cf-92dcb6b99d39 tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-8a873afe-83d3-4ae2-b7a5-acc191b09436-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-be25a74b-0421-4929-b123-c52ab7e4c3ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleting offline snapshot be25a74b-0421-4929-b123-c52ab7e4c3ee of volume b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] snapshot_file for this snap is: volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-783c77bf-2e80-46fb-92ca-73a06222f32a-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[835f7674-eaca-4f93-9618-f1ac90180ae7]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-783c77bf-2e80-46fb-92ca-73a06222f32a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[142d0909-4057-46c1-a055-22694a30ad97]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:58 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee
Sep 16 22:09:58 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:58 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a
Sep 16 22:09:58 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:58 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee" returned: 0 in 0.515s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b97e1800-a8e3-473c-b179-aefd7e818184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50563b3-470d-417d-80ab-37c66cf743a0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:58 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a" returned: 0 in 0.440s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:58 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a
Sep 16 22:09:58 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:58 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184
Sep 16 22:09:58 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:59 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-783c77bf-2e80-46fb-92ca-73a06222f32a" returned: 0 in 0.349s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-783c77bf-2e80-46fb-92ca-73a06222f32a" released by "delete_volume" :: held 0.883s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:59 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184" returned: 0 in 0.437s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:59 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee
Sep 16 22:09:59 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Created reservations ['53cb79a9-a8e1-4301-ac7f-1c96b05e25be', '24b4ee99-e13a-4000-a5ff-d8985062b681', 'c3704a34-6b8e-4450-8661-64ad4c7a3610', '62ce8542-dcd8-4c42-a33f-db895c36638a'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:59 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:09:59 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:59 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee" returned: 0 in 0.424s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:59 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.321s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:09:59 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee
Sep 16 22:09:59 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:09:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a43e2024-3987-4756-a70b-b2fe66db431a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-783c77bf-2e80-46fb-92ca-73a06222f32a-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:09:59 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184.be25a74b-0421-4929-b123-c52ab7e4c3ee" returned: 0 in 0.330s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (867d19ea-8ad9-41b7-b1cb-580b1316185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86d390d-0f9d-4068-b499-61927fc8cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86d390d-0f9d-4068-b499-61927fc8cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888322142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04668d94-ddc0-44e8-bb3c-d8b7bffa9d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:00Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f469c-802b-41e8-ae99-785ac1acaeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2f469c-802b-41e8-ae99-785ac1acaeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff5597e-8a3e-44ea-8eac-028366c3d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff5597e-8a3e-44ea-8eac-028366c3d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04668d94-ddc0-44e8-bb3c-d8b7bffa9d21', 'volume_name': 'volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3476e0f2-101c-4585-bb06-3e3651659eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3476e0f2-101c-4585-bb06-3e3651659eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4f04b8-a6bc-441e-af47-8845c267929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:09:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Volume 04668d94-ddc0-44e8-bb3c-d8b7bffa9d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21', 'volume_size': 1}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888322142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04668d94-ddc0-44e8-bb3c-d8b7bffa9d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:00Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Creating volume 04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:09:59 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:09:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-be25a74b-0421-4929-b123-c52ab7e4c3ee" released by "_delete_snapshot" :: held 1.959s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" released by "delete_snapshot" :: held 2.000s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:00 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 1073741824
Sep 16 22:10:00 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['11b3c503-2442-4968-9590-ec007bfa823e', '5f8bb02a-c73f-482b-9915-d0014a03e3d7', 'b6665d08-2b6b-426f-a8f0-7689245a0929', 'f664ff51-3961-4afd-9242-be3f857bbf88'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Delete snapshot completed successfully.
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4851c57d-39f2-49fb-a28d-5ffaefd5258d tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-be25a74b-0421-4929-b123-c52ab7e4c3ee-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:00 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 1073741824" returned: 0 in 0.576s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:00 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21
Sep 16 22:10:00 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:00 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" returned: 0 in 0.314s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4f04b8-a6bc-441e-af47-8845c267929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117af21b-fa55-4f56-8ac5-dd42c64847f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:00 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Volume volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 (04668d94-ddc0-44e8-bb3c-d8b7bffa9d21): created successfully
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117af21b-fa55-4f56-8ac5-dd42c64847f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (867d19ea-8ad9-41b7-b1cb-580b1316185d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-caf8b3b4-bf82-4fb1-b53b-3ce86b1038d3 tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-b97e1800-a8e3-473c-b179-aefd7e818184-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-b97e1800-a8e3-473c-b179-aefd7e818184-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b5af0-6c12-482e-b356-7317f31a7720]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:01 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184
Sep 16 22:10:01 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:01 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184" returned: 0 in 0.446s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:01 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184
Sep 16 22:10:01 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=213,cinder:UPDATE=276,cinder:INSERT=72,cinder:DELETE=28 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=282,cinder:SELECT=194,cinder:DELETE=22,cinder:INSERT=70 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot d105d0bd-0d62-42bb-9d42-202002e825fc of volume 04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:02 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b97e1800-a8e3-473c-b179-aefd7e818184" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20582e5-932c-41dc-bacf-a67057082ccd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-quobyte-b97e1800-a8e3-473c-b179-aefd7e818184" released by "delete_volume" :: held 0.952s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Created reservations ['de000e50-ab32-4791-8eab-bcda33eff7b8', 'c71a6d9c-1ad3-4fcc-97f0-cf124dd530fb', '5af87be1-074b-41a8-bf80-9f453c310636', 'd1917ffe-7d44-4172-8924-43555388d43d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:02 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21
Sep 16 22:10:02 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:02 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:02 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:02 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:02 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Deleted volume successfully.
Sep 16 22:10:02 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4717c04f-ccdb-4ebb-b189-5559327a2eca tempest-CreateVolumesFromSnapshotTest-824763280 None] Lock "cinder-b97e1800-a8e3-473c-b179-aefd7e818184-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" returned: 0 in 0.508s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:02 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc 1G
Sep 16 22:10:02 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:03 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc 1G" returned: 0 in 0.483s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:03 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc
Sep 16 22:10:03 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:03 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc" returned: 0 in 0.515s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:03 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc is being set with open permissions: ugo+rw
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:03 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc
Sep 16 22:10:03 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (fcc0c085-a397-40fa-a4e2-72a0431e1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b474f2c-38b4-4b08-9454-d26ebeda680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b474f2c-38b4-4b08-9454-d26ebeda680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421331223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e872ecbc-1232-49ba-a8f5-2840e7032d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:04Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66de29d-3c26-4694-8066-a997fa331d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66de29d-3c26-4694-8066-a997fa331d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3f12ca-a787-4adf-95b3-2e2627bb3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3f12ca-a787-4adf-95b3-2e2627bb3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e872ecbc-1232-49ba-a8f5-2840e7032d7c', 'volume_name': 'volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8570264e-816c-49a5-81ca-cf86c6eee587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8570264e-816c-49a5-81ca-cf86c6eee587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39ae1b8-42a6-4f00-aac7-f565a1c1c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:03 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Volume e872ecbc-1232-49ba-a8f5-2840e7032d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c', 'volume_size': 1}
Sep 16 22:10:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:04 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc" returned: 0 in 0.281s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:04 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info
Sep 16 22:10:04 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:04 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info" returned: 0 in 0.293s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:04 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info is being set with open permissions: ugo+rw
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:04 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info
Sep 16 22:10:04 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:04 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.info" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421331223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e872ecbc-1232-49ba-a8f5-2840e7032d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:04Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Creating volume e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:04 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:04 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c 1073741824
Sep 16 22:10:04 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d14e7d8b-81f0-4078-ad83-4c4bbc5f4649 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:05 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c 1073741824" returned: 0 in 0.528s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:05 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c
Sep 16 22:10:05 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-d105d0bd-0d62-42bb-9d42-202002e825fc-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-d105d0bd-0d62-42bb-9d42-202002e825fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-d105d0bd-0d62-42bb-9d42-202002e825fc" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-d105d0bd-0d62-42bb-9d42-202002e825fc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot d105d0bd-0d62-42bb-9d42-202002e825fc of volume 04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe22a2e-9df5-4774-9b21-9f503653df44]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:05 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Flow 'volume_create_manager' (4c38a31b-490e-487d-9fed-6e6a94253398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6d209-0214-4b29-8085-ddb2be032710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc6d209-0214-4b29-8085-ddb2be032710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469022184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f089403b-5a33-4b4d-8ddc-b601fee85781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49688ca62b74879ad0936c815cae996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:05Z,use_quota=True,user_id='d411bae1c38449e6a499de6118946d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b1a37b-7a01-4ccd-bc92-3c372d5d4b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b1a37b-7a01-4ccd-bc92-3c372d5d4b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303964c5-572a-4c2b-b73c-c1abd5f6ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303964c5-572a-4c2b-b73c-c1abd5f6ebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f089403b-5a33-4b4d-8ddc-b601fee85781', 'volume_name': 'volume-f089403b-5a33-4b4d-8ddc-b601fee85781', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdccdbdb-6da1-4917-803d-9c33f6ee880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdccdbdb-6da1-4917-803d-9c33f6ee880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017648e7-2f6c-408d-a31a-9ad9c08c62ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Volume f089403b-5a33-4b4d-8ddc-b601fee85781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f089403b-5a33-4b4d-8ddc-b601fee85781', 'volume_size': 1}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-469022184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f089403b-5a33-4b4d-8ddc-b601fee85781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49688ca62b74879ad0936c815cae996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:05Z,use_quota=True,user_id='d411bae1c38449e6a499de6118946d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Creating volume f089403b-5a33-4b4d-8ddc-b601fee85781 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:05 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc
Sep 16 22:10:05 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:05 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39ae1b8-42a6-4f00-aac7-f565a1c1c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e060fe6-46a9-4ce3-811c-4979e6880ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:05 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 1073741824
Sep 16 22:10:05 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:05 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Volume volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c (e872ecbc-1232-49ba-a8f5-2840e7032d7c): created successfully
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e060fe6-46a9-4ce3-811c-4979e6880ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:05 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (fcc0c085-a397-40fa-a4e2-72a0431e1881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b16a6f9d-52c9-4d7d-8103-0e53d622a1d9 tempest-ProjectReaderTests-1250404095 None] Created volume successfully.
Sep 16 22:10:06 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc" returned: 0 in 0.443s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044fb25-fbe7-4982-a017-a8e2563b0f6c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:06 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21
Sep 16 22:10:06 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:06 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 1073741824" returned: 0 in 0.463s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:06 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781
Sep 16 22:10:06 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:06 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:06 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc
Sep 16 22:10:06 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:06 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781" returned: 0 in 0.267s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017648e7-2f6c-408d-a31a-9ad9c08c62ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f089403b-5a33-4b4d-8ddc-b601fee85781', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83efc472-c323-4746-aaa2-0bab56224b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:06 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Volume volume-f089403b-5a33-4b4d-8ddc-b601fee85781 (f089403b-5a33-4b4d-8ddc-b601fee85781): created successfully
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83efc472-c323-4746-aaa2-0bab56224b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Flow 'volume_create_manager' (4c38a31b-490e-487d-9fed-6e6a94253398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:06 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c5f60a90-7b4e-453c-9430-19b3481ca4ee tempest-ProjectReaderTests-372091347 None] Created volume successfully.
Sep 16 22:10:06 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:06 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc
Sep 16 22:10:06 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Creating offline snapshot a384ea78-91ec-41c0-b56a-143c465e73a7 of volume e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:07 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21.d105d0bd-0d62-42bb-9d42-202002e825fc" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cede230-67b5-4ed8-bd7a-9aefd7b52a9f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-d105d0bd-0d62-42bb-9d42-202002e825fc" released by "_delete_snapshot" :: held 1.714s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" released by "delete_snapshot" :: held 1.752s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:07 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c
Sep 16 22:10:07 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Created reservations ['df6d2aa0-0fe4-4b5e-8938-fe07f9de5205', '6d65d9c5-c268-4040-956e-e31e87ed3c4c', '34a98551-09f6-4b14-ba1a-617725e7d918', '0bb1c330-799e-424d-9157-11fc5845d661'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-2e00980a-ac7d-4156-822a-33dcb7f9a4a0 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-d105d0bd-0d62-42bb-9d42-202002e825fc-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:07 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c" returned: 0 in 0.413s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:07 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 1G
Sep 16 22:10:07 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" acquired by "delete_volume" :: waited 0.027s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[350fc8df-71b9-42f2-b158-1c960440b26d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Acquiring lock "cinder-f089403b-5a33-4b4d-8ddc-b601fee85781-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "cinder-f089403b-5a33-4b4d-8ddc-b601fee85781-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:08 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21
Sep 16 22:10:08 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Acquiring lock "cinder-quobyte-f089403b-5a33-4b4d-8ddc-b601fee85781" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "cinder-quobyte-f089403b-5a33-4b4d-8ddc-b601fee85781" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:08 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[04473c99-55cd-4427-972a-79076b2f36c4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 1G" returned: 0 in 0.566s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7
Sep 16 22:10:08 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781
Sep 16 22:10:08 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" returned: 0 in 0.496s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21
Sep 16 22:10:08 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7" returned: 0 in 0.360s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 is being set with open permissions: ugo+rw
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781" returned: 0 in 0.403s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7
Sep 16 22:10:08 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781
Sep 16 22:10:08 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" returned: 0 in 0.344s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21" released by "delete_volume" :: held 0.940s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:08 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7" returned: 0 in 0.284s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Created reservations ['2b957d70-f34b-47c3-95e2-60e48894d732', 'a86185d3-3eb2-4e70-87be-c62cf609963d', '4f72df6f-4c3f-4475-81e1-94f9ac0d7b81', '5d4245a0-664d-46ee-a034-44118a68c618'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:08 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info
Sep 16 22:10:08 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:08 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Flow 'volume_create_manager' (f6e5b358-409e-49c6-abd2-a82a604cdd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d97ec8-181f-4958-9c44-7f0ed396be24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-f089403b-5a33-4b4d-8ddc-b601fee85781" returned: 0 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d97ec8-181f-4958-9c44-7f0ed396be24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbb769b-ac01-4aa5-8bbf-403875e9f5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a06f0143b144285ae3b5f1dd6cf5fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:09Z,use_quota=True,user_id='c8ae0e448b52407d9b2d1b7f3c490349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1752368-0a05-4e48-8e51-5346410327ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1752368-0a05-4e48-8e51-5346410327ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1491b44-f1b0-4f6b-aa10-2417c1b1b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.image.glance [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Creating Keystone auth plugin from conf {{(pid=85936) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 22:10:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "cinder-quobyte-f089403b-5a33-4b4d-8ddc-b601fee85781" released by "delete_volume" :: held 0.879s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:09 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:09 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Created reservations ['9f278e3a-40e8-4f34-b5ab-b147fe20a7ef', '85058671-52f5-4e01-b48f-b89a30594d0c', '8863f2c5-5d36-4504-aef1-4dfb13f0c21f', '127b2536-de10-4c92-b173-8eb0c8c024a9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:09 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info" returned: 0 in 0.300s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:09 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info is being set with open permissions: ugo+rw
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:09 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info
Sep 16 22:10:09 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:09 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:09 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1491b44-f1b0-4f6b-aa10-2417c1b1b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bbb769b-ac01-4aa5-8bbf-403875e9f5fb', 'volume_name': 'volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb', 'volume_size': 1, 'image_id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e8698c889b4ef2e62ee5a2f263963b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a06f0143b144285ae3b5f1dd6cf5fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42ef7b6fa2cc43aaa31e710b58b40d0d2c31ccfec58b02c95004247f0245707ee4bd23a7fb0bf4f98dbb9dbb080f010b3da9ee87f6d1e904b281081e4c98ce37', 'id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'created_at': datetime.datetime(2026, 9, 16, 20, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c2e1daf-8293-4999-b783-8f90f32259cb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd72210>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089204b-238e-4f7d-8bbf-702462c79420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089204b-238e-4f7d-8bbf-702462c79420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304a5aa4-1cf7-4230-ae27-3c45fd57de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb', 'volume_size': 1, 'image_id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e8698c889b4ef2e62ee5a2f263963b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a06f0143b144285ae3b5f1dd6cf5fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42ef7b6fa2cc43aaa31e710b58b40d0d2c31ccfec58b02c95004247f0245707ee4bd23a7fb0bf4f98dbb9dbb080f010b3da9ee87f6d1e904b281081e4c98ce37', 'id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'created_at': datetime.datetime(2026, 9, 16, 20, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c2e1daf-8293-4999-b783-8f90f32259cb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd72210>}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Trying to clone 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb from image 1c2e1daf-8293-4999-b783-8f90f32259cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}]). {{(pid=85936) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 22:10:09 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:09 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.info" returned: 0 in 0.330s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-e119237d-2749-4512-ac47-60770fe6e547 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-04668d94-ddc0-44e8-bb3c-d8b7bffa9d21-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-45509a0c-393c-4c72-93c9-058e552cbbf0 tempest-ProjectReaderTests-1250404095 None] Create snapshot completed successfully
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 22:10:09 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.335s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Deleted volume successfully.
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a171c9-b29c-4384-93de-a159010e4032]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9e6767d4-d0b7-411f-98e0-1141220218a6 tempest-ProjectReaderTests-372091347 None] Lock "cinder-f089403b-5a33-4b4d-8ddc-b601fee85781-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:09 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:09 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Flow 'volume_create_manager' (a0eb4b90-0418-4017-bf1b-8ad2edf7168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec8400-5618-488a-b399-0e1d731ac7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ec8400-5618-488a-b399-0e1d731ac7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875229507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfe9cc8-5d9d-4b35-b8b2-8556d92398a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49688ca62b74879ad0936c815cae996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:10Z,use_quota=True,user_id='d411bae1c38449e6a499de6118946d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d56a98-ded9-4d37-b837-366ebba82713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d56a98-ded9-4d37-b837-366ebba82713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03da1f-6bd8-42e2-bc09-6f86ea7ddf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed03da1f-6bd8-42e2-bc09-6f86ea7ddf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edfe9cc8-5d9d-4b35-b8b2-8556d92398a4', 'volume_name': 'volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7452d0b-7662-45d7-a712-7dd5550286c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7452d0b-7662-45d7-a712-7dd5550286c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bdbbbe-9b55-40d4-b71f-f4a60a53fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Volume edfe9cc8-5d9d-4b35-b8b2-8556d92398a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4', 'volume_size': 1}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875229507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfe9cc8-5d9d-4b35-b8b2-8556d92398a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49688ca62b74879ad0936c815cae996',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:10Z,use_quota=True,user_id='d411bae1c38449e6a499de6118946d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Creating volume edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:09 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:09 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 1073741824
Sep 16 22:10:09 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:09 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:10 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:10 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Temporary image 1c2e1daf-8293-4999-b783-8f90f32259cb is fetched for user c8ae0e448b52407d9b2d1b7f3c490349. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[386389ac-59e4-4fbc-938c-410ad6e6bc26]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:10 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (080f3b9a-70cf-49de-a4fc-02bfdb6d133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d889a5b4-f1f7-4e35-b079-d92c0f147d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-a384ea78-91ec-41c0-b56a-143c465e73a7-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 1073741824" returned: 0 in 0.638s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d889a5b4-f1f7-4e35-b079-d92c0f147d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29725388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f2b46f-e882-4af4-a871-d24abeacffd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:10Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a803157-8ae9-4a1b-b706-f1836312c154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a803157-8ae9-4a1b-b706-f1836312c154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:10 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:10 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe6932-0131-4970-819b-15e854b398bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe6932-0131-4970-819b-15e854b398bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f2b46f-e882-4af4-a871-d24abeacffd7', 'volume_name': 'volume-22f2b46f-e882-4af4-a871-d24abeacffd7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc707d6e-87a1-4a9a-b5a9-fad3f58a6e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc707d6e-87a1-4a9a-b5a9-fad3f58a6e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb74fad-8d54-42b6-b353-ab246a97011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Volume 22f2b46f-e882-4af4-a871-d24abeacffd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f2b46f-e882-4af4-a871-d24abeacffd7', 'volume_size': 1}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-a384ea78-91ec-41c0-b56a-143c465e73a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-a384ea78-91ec-41c0-b56a-143c465e73a7" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-a384ea78-91ec-41c0-b56a-143c465e73a7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Deleting offline snapshot a384ea78-91ec-41c0-b56a-143c465e73a7 of volume e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] snapshot_file for this snap is: volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1429af-8625-4f31-9933-7837a4dbbfe3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4
Sep 16 22:10:10 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:10 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7
Sep 16 22:10:10 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:10 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:10 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:10 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" returned: 0 in 0.266s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-29725388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f2b46f-e882-4af4-a871-d24abeacffd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:10Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Creating volume 22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:10 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bdbbbe-9b55-40d4-b71f-f4a60a53fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0938e6b-6c14-437c-8db0-bd264ea1aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:10 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 1073741824
Sep 16 22:10:10 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Volume volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 (edfe9cc8-5d9d-4b35-b8b2-8556d92398a4): created successfully
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0938e6b-6c14-437c-8db0-bd264ea1aacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Flow 'volume_create_manager' (a0eb4b90-0418-4017-bf1b-8ad2edf7168b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b307bdce-9a02-4a0d-8dc3-1a92c0a1ff8e tempest-ProjectReaderTests-372091347 None] Created volume successfully.
Sep 16 22:10:11 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c271e297-e846-451f-a75a-4fd41620f785]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:11 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:11 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c
Sep 16 22:10:11 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:11 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 1073741824" returned: 0 in 0.430s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:11 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7
Sep 16 22:10:11 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:11 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:11 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7
Sep 16 22:10:11 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:11 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbb769b-ac01-4aa5-8bbf-403875e9f5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a06f0143b144285ae3b5f1dd6cf5fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:09Z,use_quota=True,user_id='c8ae0e448b52407d9b2d1b7f3c490349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Creating volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:11 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:11 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1073741824
Sep 16 22:10:11 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb74fad-8d54-42b6-b353-ab246a97011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f2b46f-e882-4af4-a871-d24abeacffd7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74daea5-3432-401a-a223-46f2ba6becfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:11 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Volume volume-22f2b46f-e882-4af4-a871-d24abeacffd7 (22f2b46f-e882-4af4-a871-d24abeacffd7): created successfully
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74daea5-3432-401a-a223-46f2ba6becfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (080f3b9a-70cf-49de-a4fc-02bfdb6d133e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:11 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a3919640-e556-42da-badb-6cc2e2c5d930 tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Acquiring lock "cinder-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:11 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7" returned: 0 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "cinder-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:11 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7
Sep 16 22:10:11 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Acquiring lock "cinder-quobyte-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "cinder-quobyte-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d0829-8849-4ca4-b4f6-8eb62bf55d79]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:12 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:12 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4
Sep 16 22:10:12 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1073741824" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:12 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c.a384ea78-91ec-41c0-b56a-143c465e73a7" returned: 0 in 0.282s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-a384ea78-91ec-41c0-b56a-143c465e73a7" released by "_delete_snapshot" :: held 1.611s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" released by "delete_snapshot" :: held 1.645s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:12 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb
Sep 16 22:10:12 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Created reservations ['e5ced3d7-c8dd-4ddc-91fd-da7a9c297630', '8a20abed-409a-4f40-99c2-800c1db052ec', '6cd6dcbd-7e7f-4147-b976-a1bdaca644a7', '4f31ec32-a79d-4474-92f8-9f64ed22edc9'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Delete snapshot completed successfully.
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7ee6a170-1811-45c5-a699-5b217333fc8b tempest-ProjectReaderTests-1250404095 None] Lock "cinder-a384ea78-91ec-41c0-b56a-143c465e73a7-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:12 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:12 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4
Sep 16 22:10:12 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:12 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" returned: 0 in 0.274s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Attempting download of 1c2e1daf-8293-4999-b783-8f90f32259cb ((None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}])) to volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b810ec-6fee-4d44-8590-e60b388d23e6]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-e872ecbc-1232-49ba-a8f5-2840e7032d7c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-e872ecbc-1232-49ba-a8f5-2840e7032d7c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:12 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf
Sep 16 22:10:12 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:12 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "cinder-quobyte-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4" released by "delete_volume" :: held 0.797s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" acquired by "delete_volume" :: waited 0.026s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 84a5dc35-bf0c-426b-bd46-de03cb2ddf4f of volume 22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[383fb065-8d71-4bf6-a9bf-feb6b1c56570]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152d669-b4d6-407b-88ab-c78f35e81075]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Created reservations ['fc31f44a-f2dd-4a0d-aafc-bee8cd65ed09', 'b85dcd98-6838-42ce-92f6-4b52b31156fc', 'd418dd2c-a6d3-4ce1-81d0-8333667b2e29', 'c84f4bdd-4d9e-47e0-88e0-e649396eee89'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:13 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf" returned: 0 in 0.428s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c
Sep 16 22:10:13 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:13 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7
Sep 16 22:10:13 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:13 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack sudo[105767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf
Sep 16 22:10:13 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c" returned: 0 in 0.501s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7" returned: 0 in 0.526s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c
Sep 16 22:10:13 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf" returned: 1 in 0.477s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c2e1daf-8293-4999-b783-8f90f32259cb_sw6mcivf' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:10:13 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f 1G
Sep 16 22:10:13 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b1c73-87fb-44c5-bde0-e24717394649]: (4, 'raw') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:13 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Deleted volume successfully.
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7a00efaf-42a1-4a67-8bd3-366c78dfd74d tempest-ProjectReaderTests-372091347 None] Lock "cinder-edfe9cc8-5d9d-4b35-b8b2-8556d92398a4-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:13 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:13 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:13 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-e872ecbc-1232-49ba-a8f5-2840e7032d7c" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-e872ecbc-1232-49ba-a8f5-2840e7032d7c" released by "delete_volume" :: held 0.924s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Created reservations ['5c09ec67-4f5b-4ab4-9f14-9eb46564da59', '11d51d81-4fcf-46b7-8e23-c7df7bb0246a', '9677fea6-8f24-429d-b4e9-56c164e69916', '323c0f68-a997-40cf-ba7d-3685bd9366b7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:13 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:13 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:14 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:14 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f 1G" returned: 0 in 0.571s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f2b46f-e882-4af4-a871-d24abeacffd7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f2b46f-e882-4af4-a871-d24abeacffd7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f
Sep 16 22:10:14 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:14 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD
Sep 16 22:10:14 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:14 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:14 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Deleted volume successfully.
Sep 16 22:10:14 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-734d1aed-e2f2-4bae-b34d-86d8cba3de77 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-e872ecbc-1232-49ba-a8f5-2840e7032d7c-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] 1c2e1daf-8293-4999-b783-8f90f32259cb was raw, converting to qcow2 {{(pid=85936) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f2b46f-e882-4af4-a871-d24abeacffd7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" returned: 0 in 0.399s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f is being set with open permissions: ugo+rw
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb
Sep 16 22:10:14 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:14 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f
Sep 16 22:10:14 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:14 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" returned: 0 in 0.280s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:14 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:14 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info
Sep 16 22:10:14 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:15 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" returned: 0 in 0.606s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c2e1daf-8293-4999-b783-8f90f32259cb_fxw39_jjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:15 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1G
Sep 16 22:10:15 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:15 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info" returned: 0 in 0.325s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:15 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info is being set with open permissions: ugo+rw
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:15 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info
Sep 16 22:10:15 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:15 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.info" returned: 0 in 0.299s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-97e10569-592a-4e66-95c9-170fc39c814c tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:15 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb 1G" returned: 0 in 0.503s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Downloaded image 1c2e1daf-8293-4999-b783-8f90f32259cb ((None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}])) to volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb successfully. {{(pid=85936) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Temporary image 1c2e1daf-8293-4999-b783-8f90f32259cb for user c8ae0e448b52407d9b2d1b7f3c490349 is deleted. {{(pid=85936) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.volume_utils [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Marking volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb as bootable. {{(pid=85936) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Copying metadata from image 1c2e1daf-8293-4999-b783-8f90f32259cb to 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb. {{(pid=85936) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Creating volume glance metadata for volume 9bbb769b-ac01-4aa5-8bbf-403875e9f5fb backed by image 1c2e1daf-8293-4999-b783-8f90f32259cb with: {'image_id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '34e8698c889b4ef2e62ee5a2f263963b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85936) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (ed4ba653-2555-45be-a2b8-297009cc9d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0ee3e9-224c-475f-b859-26bb65f85221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0ee3e9-224c-475f-b859-26bb65f85221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841886550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f346ea-98e1-4b1c-b105-e7ead46eef6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:16Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddabf09-f6aa-48b2-bbbd-55221f49d270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddabf09-f6aa-48b2-bbbd-55221f49d270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d63b16-60c3-4dcd-92fd-426cf29a10d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d63b16-60c3-4dcd-92fd-426cf29a10d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f346ea-98e1-4b1c-b105-e7ead46eef6c', 'volume_name': 'volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d05c00-ea0e-4242-89e9-95b98406c253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d05c00-ea0e-4242-89e9-95b98406c253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe142f-8920-41cc-adf9-d37bf4d88921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Volume b3f346ea-98e1-4b1c-b105-e7ead46eef6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c', 'volume_size': 1}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-841886550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f346ea-98e1-4b1c-b105-e7ead46eef6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:16Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Creating volume b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304a5aa4-1cf7-4230-ae27-3c45fd57de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb', 'volume_size': 1, 'image_id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c2e1daf-8293-4999-b783-8f90f32259cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34e8698c889b4ef2e62ee5a2f263963b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a06f0143b144285ae3b5f1dd6cf5fb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42ef7b6fa2cc43aaa31e710b58b40d0d2c31ccfec58b02c95004247f0245707ee4bd23a7fb0bf4f98dbb9dbb080f010b3da9ee87f6d1e904b281081e4c98ce37', 'id': '1c2e1daf-8293-4999-b783-8f90f32259cb', 'created_at': datetime.datetime(2026, 9, 16, 20, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 20, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c2e1daf-8293-4999-b783-8f90f32259cb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d82afd72210>}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c 1073741824
Sep 16 22:10:15 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68421fc-92b0-4598-bf06-34e2c81d71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Volume volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb (9bbb769b-ac01-4aa5-8bbf-403875e9f5fb): created successfully
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68421fc-92b0-4598-bf06-34e2c81d71ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:15 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Flow 'volume_create_manager' (f6e5b358-409e-49c6-abd2-a82a604cdd04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:15 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0218387e-37a3-4f9d-8fbf-2cc2019ff3e6 tempest-VolumeImageDependencyTests-732831683 None] Created volume successfully.
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 84a5dc35-bf0c-426b-bd46-de03cb2ddf4f of volume 22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e88de78-cac4-4ac2-aef9-03c68b50b64c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:16 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c 1073741824" returned: 0 in 0.510s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:16 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c
Sep 16 22:10:16 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:16 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f
Sep 16 22:10:16 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:16 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Acquiring lock "cinder-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" returned: 0 in 0.318s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe142f-8920-41cc-adf9-d37bf4d88921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b9a311-1943-4311-92bf-75fe2973c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "cinder-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:16 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Volume volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c (b3f346ea-98e1-4b1c-b105-e7ead46eef6c): created successfully
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b9a311-1943-4311-92bf-75fe2973c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (ed4ba653-2555-45be-a2b8-297009cc9d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:16 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-b3ff468b-9dcc-496a-bdaa-cf977fef89ab tempest-ProjectReaderTests-1250404095 None] Created volume successfully.
Sep 16 22:10:16 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" returned: 0 in 0.472s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f2b46f-e882-4af4-a871-d24abeacffd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Acquiring lock "cinder-quobyte-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea9c18b-10d6-4031-a9d4-bec2f11cf425]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "cinder-quobyte-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" acquired by "delete_volume" :: waited 0.030s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae3735-4ec3-4ddd-8bd5-3f438995e945]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:16 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:16 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7
Sep 16 22:10:16 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:16 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb
Sep 16 22:10:16 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:17 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7" returned: 0 in 0.414s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:17 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f
Sep 16 22:10:17 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:17 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" returned: 0 in 0.422s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:17 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb
Sep 16 22:10:17 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:17 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "cinder-quobyte-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb" released by "delete_volume" :: held 0.742s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:17 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:17 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f
Sep 16 22:10:17 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Created reservations ['2905e9d3-3fe9-4b74-83db-9566a9834682', 'f738e746-ecb1-4c09-89ca-e21a20f93a26', '7cd3e843-8918-4252-a44e-792c5efb27bb', '3525b2ea-884b-41ac-9862-591193dd5427'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:17 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:17 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:17 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7.84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" returned: 0 in 0.427s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f" released by "_delete_snapshot" :: held 1.834s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" released by "delete_snapshot" :: held 1.868s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:17 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Creating offline snapshot 5287a630-2a40-4507-b2b9-6b355dee3f7d of volume b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:18 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3630261-cc04-42b2-80fd-9c044aebe72d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Deleted volume successfully.
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-3425105e-dbff-455a-a21b-9f2301930095 tempest-VolumeImageDependencyTests-732831683 None] Lock "cinder-9bbb769b-ac01-4aa5-8bbf-403875e9f5fb-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Created reservations ['592e83d6-83e0-431d-8dcb-49733dae12f9', 'f6b7a163-3f34-4bc9-9391-8cb9189cb362', '64cee9b2-8a2b-467f-9606-75325de44e7e', '6a3bff06-c645-470f-8562-ddd7f2aa1e42'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:18 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c
Sep 16 22:10:18 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:18 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-65434b75-a232-4af0-9e70-fdf651704c0c tempest-ProjectMemberTests-2129052031 None] Lock "cinder-84a5dc35-bf0c-426b-bd46-de03cb2ddf4f-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-22f2b46f-e882-4af4-a871-d24abeacffd7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-22f2b46f-e882-4af4-a871-d24abeacffd7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd293469-f283-4a45-bc78-133e0900a9fd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:18 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" returned: 0 in 0.545s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:18 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:18 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d 1G
Sep 16 22:10:18 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:18 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7
Sep 16 22:10:18 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:19 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7" returned: 0 in 0.562s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:19 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7
Sep 16 22:10:19 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:19 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d 1G" returned: 0 in 0.586s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:19 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d
Sep 16 22:10:19 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:19 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-22f2b46f-e882-4af4-a871-d24abeacffd7" returned: 0 in 0.396s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-22f2b46f-e882-4af4-a871-d24abeacffd7" released by "delete_volume" :: held 1.045s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:19 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d" returned: 0 in 0.358s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:19 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d is being set with open permissions: ugo+rw
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Created reservations ['1036be53-a500-461b-913d-1e63b4946edb', 'effd05f6-f8f1-4dac-9ed6-ede778e4a955', '0fb5014f-70ae-4eb0-ab4e-9b00a42767cc', '8e5bf0f1-f2b8-401c-8c26-678418c7fe75'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:19 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d
Sep 16 22:10:19 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:19 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:19 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:19 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:19 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:19 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info
Sep 16 22:10:19 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:20 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.416s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-97f62ad4-8161-416d-bed8-aaf9292a6b37 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-22f2b46f-e882-4af4-a871-d24abeacffd7-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:20 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:20 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info is being set with open permissions: ugo+rw
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:20 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info
Sep 16 22:10:20 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:20 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.info" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:20 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:20 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c6a9458c-181d-40b6-a82e-b503fd67b98c tempest-ProjectReaderTests-1250404095 None] Create snapshot completed successfully
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (8980ab78-7f9a-4847-9b09-3a9b2cd5257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2054e150-7c96-4a12-8925-0a160c7690df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-5287a630-2a40-4507-b2b9-6b355dee3f7d-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2054e150-7c96-4a12-8925-0a160c7690df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736306576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5d3f7-0b4d-45c3-94f7-777c95325eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:21Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb29e5b-91d0-46a8-a223-8223a6f2964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb29e5b-91d0-46a8-a223-8223a6f2964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5617ba32-2dc7-427b-af8e-03605537a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5617ba32-2dc7-427b-af8e-03605537a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff5d3f7-0b4d-45c3-94f7-777c95325eb4', 'volume_name': 'volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e03baf6-fd63-4f74-b830-5e0e2e28065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e03baf6-fd63-4f74-b830-5e0e2e28065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6ec45f-4b6f-4b90-a721-63d83b438acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Volume 6ff5d3f7-0b4d-45c3-94f7-777c95325eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4', 'volume_size': 1}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736306576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff5d3f7-0b4d-45c3-94f7-777c95325eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:21Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Creating volume 6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:21 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-5287a630-2a40-4507-b2b9-6b355dee3f7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-5287a630-2a40-4507-b2b9-6b355dee3f7d" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:21 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 1073741824
Sep 16 22:10:21 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5287a630-2a40-4507-b2b9-6b355dee3f7d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Deleting offline snapshot 5287a630-2a40-4507-b2b9-6b355dee3f7d of volume b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] snapshot_file for this snap is: volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401bc7a-e5ec-4f23-9d35-bf2ead7b19ac]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:21 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d
Sep 16 22:10:21 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:21 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 1073741824" returned: 0 in 0.438s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:21 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d" returned: 0 in 0.401s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:21 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4
Sep 16 22:10:21 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc7be6-6a64-48e8-84a2-efd9cbe71739]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:21 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c
Sep 16 22:10:21 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:21 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6ec45f-4b6f-4b90-a721-63d83b438acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c810b19e-c9d3-4c07-9aea-ca1bcda0853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:21 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Volume volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 (6ff5d3f7-0b4d-45c3-94f7-777c95325eb4): created successfully
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c810b19e-c9d3-4c07-9aea-ca1bcda0853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:21 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (8980ab78-7f9a-4847-9b09-3a9b2cd5257a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:21 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a5a49dd4-1d1a-4e76-9c69-ade1e33e346f tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:22 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:22 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:22 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:22 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d
Sep 16 22:10:22 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:22 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 5a582a2a-9f3e-4793-882b-4ecb0184a09a of volume 6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.292s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31def56-34cd-4060-a620-5784a98e9538]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:22 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4
Sep 16 22:10:22 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:22 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:22 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d
Sep 16 22:10:22 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:22 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" returned: 0 in 0.366s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:22 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c.5287a630-2a40-4507-b2b9-6b355dee3f7d" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:22 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a 1G
Sep 16 22:10:22 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5287a630-2a40-4507-b2b9-6b355dee3f7d" released by "_delete_snapshot" :: held 1.520s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" released by "delete_snapshot" :: held 1.546s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Created reservations ['b79243f4-eb10-413b-bdf7-a30022cb52ff', '5e940aaa-f5af-4229-bf9b-b853c663a95f', '53657a5b-ac5a-4270-8704-a6af7f980d1d', '9fd071ea-a962-4b4b-bca9-481f453d2878'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:22 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Delete snapshot completed successfully.
Sep 16 22:10:22 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-64e58558-1d77-46ab-abcf-25d8d89ae5e7 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-5287a630-2a40-4507-b2b9-6b355dee3f7d-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:23 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a 1G" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a
Sep 16 22:10:23 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-b3f346ea-98e1-4b1c-b105-e7ead46eef6c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-b3f346ea-98e1-4b1c-b105-e7ead46eef6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e92ce5-64ff-4f3b-88b0-7ed77cf36239]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a" returned: 0 in 0.319s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:23 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a is being set with open permissions: ugo+rw
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a
Sep 16 22:10:23 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c
Sep 16 22:10:23 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a" returned: 0 in 0.238s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info
Sep 16 22:10:23 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c
Sep 16 22:10:23 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:23 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info is being set with open permissions: ugo+rw
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:23 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info
Sep 16 22:10:23 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:23 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:23 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-b3f346ea-98e1-4b1c-b105-e7ead46eef6c" released by "delete_volume" :: held 0.685s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Created reservations ['b7685995-6a18-4846-8202-7630e23e7ec6', '715308f1-d424-449f-bf5e-d8bde03f8fbf', '8e79cbff-43be-4a30-bf34-f1858f3b718f', '8a9927f7-f75a-4965-87c5-ddf193edb0a2'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:24 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:24 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:24 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.info" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-450baaca-6cd3-4cda-9bfb-6da00501e980 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:24 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:24 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Deleted volume successfully.
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-5a582a2a-9f3e-4793-882b-4ecb0184a09a-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-40b6e627-1b04-4599-bfde-4a60fc00f016 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-b3f346ea-98e1-4b1c-b105-e7ead46eef6c-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-5a582a2a-9f3e-4793-882b-4ecb0184a09a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-5a582a2a-9f3e-4793-882b-4ecb0184a09a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-5a582a2a-9f3e-4793-882b-4ecb0184a09a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 5a582a2a-9f3e-4793-882b-4ecb0184a09a of volume 6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beb52cc-ea11-4185-8e7b-fe57dc2d2aab]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:24 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a
Sep 16 22:10:24 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (d7d6bbf3-01b8-46b9-9cd7-069b47e08f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0aa14f2-afcf-4812-8208-c6a0f7904c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0aa14f2-afcf-4812-8208-c6a0f7904c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215955051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec71729-f14c-4cc2-9829-ac50d628e851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:25Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:24 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cd5200-a399-4c85-aea1-c082ae7883c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cd5200-a399-4c85-aea1-c082ae7883c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3980c7-a684-4dd2-aa1f-c72800a0968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3980c7-a684-4dd2-aa1f-c72800a0968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec71729-f14c-4cc2-9829-ac50d628e851', 'volume_name': 'volume-5ec71729-f14c-4cc2-9829-ac50d628e851', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a16fc5-31fa-4151-ae5d-48b5ccac464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a16fc5-31fa-4151-ae5d-48b5ccac464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f49180-900b-420c-858c-af3d97ebfb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:24 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Volume 5ec71729-f14c-4cc2-9829-ac50d628e851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec71729-f14c-4cc2-9829-ac50d628e851', 'volume_size': 1}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215955051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec71729-f14c-4cc2-9829-ac50d628e851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:25Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Creating volume 5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:24 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a" returned: 0 in 0.448s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:24 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 1073741824
Sep 16 22:10:24 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445fb18-bcf3-49c7-b5a3-4a455ba30b4f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:24 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:25 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4
Sep 16 22:10:25 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:25 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 1073741824" returned: 0 in 0.404s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:25 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:25 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:25 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:25 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851
Sep 16 22:10:25 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:25 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f49180-900b-420c-858c-af3d97ebfb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec71729-f14c-4cc2-9829-ac50d628e851', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74343d0b-842f-498a-92b4-75ceac5103ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:25 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Volume volume-5ec71729-f14c-4cc2-9829-ac50d628e851 (5ec71729-f14c-4cc2-9829-ac50d628e851): created successfully
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74343d0b-842f-498a-92b4-75ceac5103ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (d7d6bbf3-01b8-46b9-9cd7-069b47e08f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:25 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a" returned: 0 in 0.356s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:25 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:25 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-39d25c20-79c1-4057-a6f5-370e72960795 tempest-ProjectReaderTests-1250404095 None] Created volume successfully.
Sep 16 22:10:25 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a
Sep 16 22:10:25 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:25 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4.5a582a2a-9f3e-4793-882b-4ecb0184a09a" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-5a582a2a-9f3e-4793-882b-4ecb0184a09a" released by "_delete_snapshot" :: held 1.562s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" released by "delete_snapshot" :: held 1.590s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Creating offline snapshot 7328fc40-e88c-417b-9d74-102d87f0fc2e of volume 5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1708cb-b63a-4b4a-a1e9-08cfa8998f3f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Created reservations ['1ffffcdf-275a-4336-b0d8-cc5bcfcf56c6', '8dbe71d6-586f-4422-86cc-8e0f80004d69', '1a7d4241-e8f6-4628-b2b9-ba3c3b89d372', '3ade4160-645b-4f43-a8eb-e2db7e6f0755'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:26 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c5a65874-f76b-4da3-9ce9-2b8ad87d7907 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-5a582a2a-9f3e-4793-882b-4ecb0184a09a-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:26 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851
Sep 16 22:10:26 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:26 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851" returned: 0 in 0.353s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:26 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e 1G
Sep 16 22:10:26 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb74992-cd1e-4956-8f5a-d0092ec2ef9b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:26 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4
Sep 16 22:10:26 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:26 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e 1G" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:26 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec71729-f14c-4cc2-9829-ac50d628e851 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:26 devstack sudo[106021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec71729-f14c-4cc2-9829-ac50d628e851 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e
Sep 16 22:10:26 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:27 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4
Sep 16 22:10:27 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ec71729-f14c-4cc2-9829-ac50d628e851 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e" returned: 0 in 0.301s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e is being set with open permissions: ugo+rw
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:27 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e
Sep 16 22:10:27 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" returned: 0 in 0.256s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4" released by "delete_volume" :: held 0.691s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Created reservations ['054649f0-32e7-4a57-8b62-b24282031920', '7b56a10a-7c88-4dc4-9cd9-7ab1eed3c49e', '1ce372c5-3b35-4c6c-81e6-aa1c36c3c383', '7548391c-23fe-49db-a41e-36fa64ab58f7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:27 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e" returned: 0 in 0.245s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:27 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info
Sep 16 22:10:27 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:27 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:27 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info is being set with open permissions: ugo+rw
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:27 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info
Sep 16 22:10:27 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:27 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:27 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-cbeb3ba5-9f9d-47f5-9c29-0dd97e63f25a tempest-ProjectMemberTests-2129052031 None] Lock "cinder-6ff5d3f7-0b4d-45c3-94f7-777c95325eb4-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:27 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.info" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:27 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:28 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-ef7fbef8-1df3-4d68-9061-247f48f564a3 tempest-ProjectReaderTests-1250404095 None] Create snapshot completed successfully
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-7328fc40-e88c-417b-9d74-102d87f0fc2e-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-7328fc40-e88c-417b-9d74-102d87f0fc2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-7328fc40-e88c-417b-9d74-102d87f0fc2e" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (d5987107-54f7-4b60-bcc1-ad5f21e451a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fc9033-2d7f-44a8-a99b-c68413982884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-7328fc40-e88c-417b-9d74-102d87f0fc2e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Deleting offline snapshot 7328fc40-e88c-417b-9d74-102d87f0fc2e of volume 5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] snapshot_file for this snap is: volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fc9033-2d7f-44a8-a99b-c68413982884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157586234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7ad97-6149-4426-89cd-5c9226569357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:28Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1b50c-7af8-43e5-b2b6-a68a377fdb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e1b50c-7af8-43e5-b2b6-a68a377fdb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73b4e0f-c12b-44f7-8fe8-f239a09a54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73b4e0f-c12b-44f7-8fe8-f239a09a54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a7ad97-6149-4426-89cd-5c9226569357', 'volume_name': 'volume-92a7ad97-6149-4426-89cd-5c9226569357', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbed45b-8993-4d1d-8472-6d4140c510c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbed45b-8993-4d1d-8472-6d4140c510c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9d85f2-5d27-4a3e-a969-2a89f6a7f5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:28 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Volume 92a7ad97-6149-4426-89cd-5c9226569357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a7ad97-6149-4426-89cd-5c9226569357', 'volume_size': 1}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157586234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7ad97-6149-4426-89cd-5c9226569357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:28Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Creating volume 92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:28 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b491656-7092-4aa9-a2fc-0a4129199031]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:28 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 1073741824
Sep 16 22:10:28 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:28 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e
Sep 16 22:10:28 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:28 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ec71729-f14c-4cc2-9829-ac50d628e851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:28 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 1073741824" returned: 0 in 0.432s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993c87f-d83a-4c07-9426-0a409175c651]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:28 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:28 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357
Sep 16 22:10:28 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:28 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851
Sep 16 22:10:28 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:29 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357" returned: 0 in 0.247s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9d85f2-5d27-4a3e-a969-2a89f6a7f5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a7ad97-6149-4426-89cd-5c9226569357', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740f3399-ae0b-4330-ad95-92e3cd6f6e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:29 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Volume volume-92a7ad97-6149-4426-89cd-5c9226569357 (92a7ad97-6149-4426-89cd-5c9226569357): created successfully
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740f3399-ae0b-4330-ad95-92e3cd6f6e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (d5987107-54f7-4b60-bcc1-ad5f21e451a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-eef3e7b8-9ebe-45bf-a852-8709d0d4d816 tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:29 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851" returned: 0 in 0.389s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:29 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e
Sep 16 22:10:29 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 011e270b-89ab-4638-920e-a61137289de3 of volume 92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c1dcf-59cc-42ae-90f4-0c992001da89]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:29 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e" returned: 0 in 0.348s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:29 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357
Sep 16 22:10:29 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:29 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e
Sep 16 22:10:29 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:29 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851.7328fc40-e88c-417b-9d74-102d87f0fc2e" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:29 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-7328fc40-e88c-417b-9d74-102d87f0fc2e" released by "_delete_snapshot" :: held 1.548s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357" returned: 0 in 0.393s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" released by "delete_snapshot" :: held 1.603s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:29 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 1G
Sep 16 22:10:29 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Created reservations ['1db7711f-aca8-4d3c-bc63-9ffc32233a86', 'ee461fb2-85eb-484c-849f-f067e2a071ec', '3a744d50-e70c-47c6-8f58-ef7e20a84eee', 'e605eae8-1062-4490-8d0b-43959c4c9558'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:29 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Delete snapshot completed successfully.
Sep 16 22:10:29 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51626e00-fb8c-4b88-b5da-09d80d11de64 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-7328fc40-e88c-417b-9d74-102d87f0fc2e-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:30 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 1G" returned: 0 in 0.387s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a7ad97-6149-4426-89cd-5c9226569357 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:30 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a7ad97-6149-4426-89cd-5c9226569357 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3
Sep 16 22:10:30 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-5ec71729-f14c-4cc2-9829-ac50d628e851-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "cinder-5ec71729-f14c-4cc2-9829-ac50d628e851-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c630f-e4b7-4237-8361-8a09f03d0581]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:30 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a7ad97-6149-4426-89cd-5c9226569357 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:30 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 is being set with open permissions: ugo+rw
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:30 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3
Sep 16 22:10:30 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:30 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851
Sep 16 22:10:30 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:30 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:30 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info
Sep 16 22:10:30 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:30 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851" returned: 0 in 0.376s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:30 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:30 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851
Sep 16 22:10:30 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:31 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:31 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info is being set with open permissions: ugo+rw
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:31 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info
Sep 16 22:10:31 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:31 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-5ec71729-f14c-4cc2-9829-ac50d628e851" returned: 0 in 0.260s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-5ec71729-f14c-4cc2-9829-ac50d628e851" released by "delete_volume" :: held 0.701s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Created reservations ['682e15e3-20f9-4c9b-8cc5-3b1936c703cb', '80c7695b-98f7-460f-bf95-303a0d2638e0', 'a448147b-ace9-4c35-815d-05a1078430ed', 'f1093402-bbc1-4620-9ae7-e4dd3eead077'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:31 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:31 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:31 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.info" returned: 0 in 0.263s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-e8d8708f-a74c-45ff-92e1-36ad2450f40e tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:31 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.276s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:31 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Deleted volume successfully.
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-009117f2-f236-4a13-bfb8-bcd3efebb50a tempest-ProjectReaderTests-1250404095 None] Lock "cinder-5ec71729-f14c-4cc2-9829-ac50d628e851-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-011e270b-89ab-4638-920e-a61137289de3-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-011e270b-89ab-4638-920e-a61137289de3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-011e270b-89ab-4638-920e-a61137289de3" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-011e270b-89ab-4638-920e-a61137289de3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 011e270b-89ab-4638-920e-a61137289de3 of volume 92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46d7cf-79eb-4e74-ac89-16e7e004cfb0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:31 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3
Sep 16 22:10:31 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:31 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:31 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a7ad97-6149-4426-89cd-5c9226569357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (e649fd45-3fde-4e40-b073-872560152fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c10fdb6-e03a-463b-ba44-643b448abccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908fe26-5c5e-42b9-a979-d5e8493c705e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c10fdb6-e03a-463b-ba44-643b448abccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993596312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9994ca-3a8c-4285-a3fa-56f7894891a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:32Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b164ce3-be00-4bce-b607-05415815cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b164ce3-be00-4bce-b607-05415815cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4513bcd-ad8c-408e-a7bf-7bab3b7826ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4513bcd-ad8c-408e-a7bf-7bab3b7826ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f9994ca-3a8c-4285-a3fa-56f7894891a7', 'volume_name': 'volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b7132c-9cb4-4c50-8584-a48f0cc839df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b7132c-9cb4-4c50-8584-a48f0cc839df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e8823a-d5e3-46e5-ac42-340916367c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Volume 6f9994ca-3a8c-4285-a3fa-56f7894891a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7', 'volume_size': 1}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993596312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9994ca-3a8c-4285-a3fa-56f7894891a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:32Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Creating volume 6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:32 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:32 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 1073741824
Sep 16 22:10:32 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:32 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357
Sep 16 22:10:32 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:32 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357" returned: 0 in 0.369s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:32 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3
Sep 16 22:10:32 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:32 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 1073741824" returned: 0 in 0.431s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:32 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7
Sep 16 22:10:32 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:32 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:32 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3
Sep 16 22:10:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:32 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7" returned: 0 in 0.272s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e8823a-d5e3-46e5-ac42-340916367c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8611222d-c0c9-4a7f-b022-247f5fc24db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:32 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Volume volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 (6f9994ca-3a8c-4285-a3fa-56f7894891a7): created successfully
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8611222d-c0c9-4a7f-b022-247f5fc24db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:32 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (e649fd45-3fde-4e40-b073-872560152fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:32 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-03ffa91c-40a5-4dc5-9b7f-ebc541a698d7 tempest-ProjectReaderTests-1250404095 None] Created volume successfully.
Sep 16 22:10:33 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357.011e270b-89ab-4638-920e-a61137289de3" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-011e270b-89ab-4638-920e-a61137289de3" released by "_delete_snapshot" :: held 1.466s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" released by "delete_snapshot" :: held 1.489s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Created reservations ['8ca34771-69d4-478c-9c8a-5447cea35f0f', '62635370-d6f7-4530-8c8b-a36fb5d8a905', '03806098-beb6-42ea-a284-b6dfd0da87c6', 'ce12b767-d11e-4a50-9578-d668399510a8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:33 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d06169b6-4772-448e-aec3-b116b9966409 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-011e270b-89ab-4638-920e-a61137289de3-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-92a7ad97-6149-4426-89cd-5c9226569357-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-92a7ad97-6149-4426-89cd-5c9226569357-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc2e92-5766-47d4-a38c-f587160024fd]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:33 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:33 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357
Sep 16 22:10:33 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:34 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357" returned: 0 in 0.403s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:34 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357
Sep 16 22:10:34 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Creating offline snapshot 6c1e25fb-6be0-40f1-bb77-707cf317448b of volume 6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d05d25-5c72-447f-a8ef-19a32c61faf8]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:34 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7
Sep 16 22:10:34 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:34 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-92a7ad97-6149-4426-89cd-5c9226569357" returned: 0 in 0.285s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-92a7ad97-6149-4426-89cd-5c9226569357" released by "delete_volume" :: held 0.761s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Created reservations ['908de45b-bc6a-4e77-bf85-c31348270f94', '36a4af91-caba-4cdd-93ae-7e7b1573a321', '1fe8b4c1-7fee-4168-a973-31c89e9a5c1f', 'd3b815fb-7183-4b22-8dce-c221c0c070e2'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:34 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:34 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:34 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7" returned: 0 in 0.391s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:34 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b 1G
Sep 16 22:10:34 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:34 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.271s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:34 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:34 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-1643a0f8-130d-47dc-8a16-2b5c6e736b31 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-92a7ad97-6149-4426-89cd-5c9226569357-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:35 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b 1G" returned: 0 in 0.435s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:35 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b
Sep 16 22:10:35 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (51301ede-c9c4-448d-969f-9da9d10da5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb1f393-d0c1-4622-b720-2f2ee988f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb1f393-d0c1-4622-b720-2f2ee988f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937323669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0311e7-f7d3-45a2-bf01-0636256a5a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:35Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20b7fc-43cf-4f9d-b9bf-dc11e1808236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20b7fc-43cf-4f9d-b9bf-dc11e1808236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7e8f65-2a54-464a-abc0-9f3ce058d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7e8f65-2a54-464a-abc0-9f3ce058d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0311e7-f7d3-45a2-bf01-0636256a5a71', 'volume_name': 'volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3acee0b-a58a-470d-8e8c-17fcaf599b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3acee0b-a58a-470d-8e8c-17fcaf599b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db7fdf9-747c-4bda-a167-db4e975f7966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:35 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Volume cc0311e7-f7d3-45a2-bf01-0636256a5a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71', 'volume_size': 1}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:35 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b" returned: 0 in 0.315s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:35 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b is being set with open permissions: ugo+rw
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:35 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b
Sep 16 22:10:35 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:35 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:35 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info
Sep 16 22:10:35 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:35 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info" returned: 0 in 0.241s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:35 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info is being set with open permissions: ugo+rw
Sep 16 22:10:35 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:36 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info
Sep 16 22:10:36 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:36 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.info" returned: 0 in 0.241s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937323669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0311e7-f7d3-45a2-bf01-0636256a5a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:35Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Creating volume cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:36 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:36 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 1073741824
Sep 16 22:10:36 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-decee450-44fa-4ed8-ba35-eeabb1ad56b3 tempest-ProjectReaderTests-1250404095 None] Create snapshot completed successfully
Sep 16 22:10:36 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 1073741824" returned: 0 in 0.408s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:36 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71
Sep 16 22:10:36 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:36 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db7fdf9-747c-4bda-a167-db4e975f7966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2ce73-8329-4f43-9073-15882e5b03e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:36 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Volume volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 (cc0311e7-f7d3-45a2-bf01-0636256a5a71): created successfully
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2ce73-8329-4f43-9073-15882e5b03e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:36 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (51301ede-c9c4-448d-969f-9da9d10da5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:36 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8ce06254-82dd-4bff-b31d-81ae18d75abf tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-6c1e25fb-6be0-40f1-bb77-707cf317448b-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-6c1e25fb-6be0-40f1-bb77-707cf317448b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-6c1e25fb-6be0-40f1-bb77-707cf317448b" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6c1e25fb-6be0-40f1-bb77-707cf317448b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Deleting offline snapshot 6c1e25fb-6be0-40f1-bb77-707cf317448b of volume 6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] snapshot_file for this snap is: volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[26008396-532d-4317-a176-415fdc5ad83c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 3de51b57-5963-4cbf-8dbd-8928782bc879 of volume cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb72e90-7cb6-4c05-b446-1b9b9fb7b637]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:37 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b
Sep 16 22:10:37 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:37 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71
Sep 16 22:10:37 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:37 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b" returned: 0 in 0.368s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae83124-2b01-4f14-8a12-8e34892fba63]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:37 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7
Sep 16 22:10:38 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 1G
Sep 16 22:10:38 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b
Sep 16 22:10:38 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 1G" returned: 0 in 0.414s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879
Sep 16 22:10:38 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b" returned: 0 in 0.357s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b
Sep 16 22:10:38 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879" returned: 0 in 0.309s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 is being set with open permissions: ugo+rw
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:38 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879
Sep 16 22:10:38 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:38 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7.6c1e25fb-6be0-40f1-bb77-707cf317448b" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6c1e25fb-6be0-40f1-bb77-707cf317448b" released by "_delete_snapshot" :: held 1.464s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" released by "delete_snapshot" :: held 1.487s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:38 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:38 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:39 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info
Sep 16 22:10:39 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Created reservations ['6b448fc9-9723-4429-bcda-dbdbe8537b37', '2321750e-f295-494f-95d4-fd333fb27279', 'c88cc19b-439a-46bd-9b52-fa0cef3a0dac', 'dc16c49f-dc34-4f39-ada8-7c05f991e2bd'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Delete snapshot completed successfully.
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-5086fc71-0503-4ddd-9c07-6d48a2a80518 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-6c1e25fb-6be0-40f1-bb77-707cf317448b-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:39 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info" returned: 0 in 0.245s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:39 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info is being set with open permissions: ugo+rw
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:39 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info
Sep 16 22:10:39 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:39 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.info" returned: 0 in 0.235s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:39 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-1f064f63-199a-4064-be68-1ecb48e4c468 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-6f9994ca-3a8c-4285-a3fa-56f7894891a7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-6f9994ca-3a8c-4285-a3fa-56f7894891a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c7b054-a81d-4e98-96c9-c2395322ab17]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-3de51b57-5963-4cbf-8dbd-8928782bc879-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-3de51b57-5963-4cbf-8dbd-8928782bc879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-3de51b57-5963-4cbf-8dbd-8928782bc879" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-3de51b57-5963-4cbf-8dbd-8928782bc879" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 3de51b57-5963-4cbf-8dbd-8928782bc879 of volume cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b5eea-6136-4466-a890-27ca2f7ccf1a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:39 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:39 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7
Sep 16 22:10:39 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:39 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879
Sep 16 22:10:39 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:40 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7" returned: 0 in 0.382s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:40 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7
Sep 16 22:10:40 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:40 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a10124d-bcd1-4f68-81b8-df0741d1f245]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:40 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6f9994ca-3a8c-4285-a3fa-56f7894891a7" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71
Sep 16 22:10:40 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-6f9994ca-3a8c-4285-a3fa-56f7894891a7" released by "delete_volume" :: held 0.709s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Created reservations ['386efabb-bf54-4ffd-8d1e-6fc996c5eb77', '8aabb1ce-7ccf-44e5-9dfc-1ce34fc4bfe0', '368faada-0983-42b9-bfe8-25ff8894673a', '98e21fef-404a-4c99-8f4e-b974e3855b2f'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:40 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:40 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:40 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71" returned: 0 in 0.366s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:40 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879
Sep 16 22:10:40 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:40 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:40 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Deleted volume successfully.
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8c788170-0d03-46ab-bb47-bd328d41d457 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-6f9994ca-3a8c-4285-a3fa-56f7894891a7-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:40 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:40 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:41 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879
Sep 16 22:10:41 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:41 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (048f3e79-e611-4f71-952b-67d8cf284689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08853687-a25b-4893-b62b-986791ca1e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71.3de51b57-5963-4cbf-8dbd-8928782bc879" returned: 0 in 0.269s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08853687-a25b-4893-b62b-986791ca1e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052680590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13799ada-44ed-405f-976e-1b327161beb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:41Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27451735-b989-4db8-b3b4-d6b9addae22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27451735-b989-4db8-b3b4-d6b9addae22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833e537c-0b1a-47e9-af65-6c54b300d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833e537c-0b1a-47e9-af65-6c54b300d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13799ada-44ed-405f-976e-1b327161beb7', 'volume_name': 'volume-13799ada-44ed-405f-976e-1b327161beb7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38437b6-a976-4840-a415-5584c1eabd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38437b6-a976-4840-a415-5584c1eabd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903cb78-f357-4be4-a50b-094f19772f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:41 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Volume 13799ada-44ed-405f-976e-1b327161beb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13799ada-44ed-405f-976e-1b327161beb7', 'volume_size': 1}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052680590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13799ada-44ed-405f-976e-1b327161beb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a818598390431ba5045423b578e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:41Z,use_quota=True,user_id='06d2caccdd384ed2bab7bf7c289947c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Creating volume 13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:41 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-3de51b57-5963-4cbf-8dbd-8928782bc879" released by "_delete_snapshot" :: held 1.544s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" released by "delete_snapshot" :: held 1.571s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:41 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 1073741824
Sep 16 22:10:41 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Created reservations ['5f8e6518-ac3f-487d-bf5a-50f323db1e76', '2154ea3f-3350-41cd-a96c-1c8e8023eb8a', 'a22d7459-5728-40e1-8a29-9bc1f45998cb', '86b6e318-38f0-4c6f-8372-711096e23dba'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:41 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c8418e70-3bd7-417f-a320-f145a6ecdd91 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-3de51b57-5963-4cbf-8dbd-8928782bc879-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:41 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 1073741824" returned: 0 in 0.434s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:41 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7
Sep 16 22:10:41 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-cc0311e7-f7d3-45a2-bf01-0636256a5a71-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-cc0311e7-f7d3-45a2-bf01-0636256a5a71-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:41 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[59945586-41e6-4890-87c3-31a8880986a9]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:42 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903cb78-f357-4be4-a50b-094f19772f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13799ada-44ed-405f-976e-1b327161beb7', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958fae80-16bf-4ba9-8712-692e9c75f6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Volume volume-13799ada-44ed-405f-976e-1b327161beb7 (13799ada-44ed-405f-976e-1b327161beb7): created successfully
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958fae80-16bf-4ba9-8712-692e9c75f6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Flow 'volume_create_manager' (048f3e79-e611-4f71-952b-67d8cf284689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:42 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4903c21c-a316-4a29-9004-ad3b4790f88f tempest-ProjectReaderTests-1250404095 None] Created volume successfully.
Sep 16 22:10:42 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71
Sep 16 22:10:42 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Creating offline snapshot acf7898e-0605-42b3-b6d4-010adbd4331d of volume 13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5638f9-0c3a-4662-8451-182bb770faa3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:42 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71" returned: 0 in 0.386s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:42 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71
Sep 16 22:10:42 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:42 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7
Sep 16 22:10:42 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:42 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-cc0311e7-f7d3-45a2-bf01-0636256a5a71" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-cc0311e7-f7d3-45a2-bf01-0636256a5a71" released by "delete_volume" :: held 0.715s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Created reservations ['a6c7b427-a1e3-4c73-b2df-d6b0ac55c9eb', 'f4882524-45e5-4d84-a08f-3b198b85018a', '97b15135-2e4e-4953-b00c-73733f0ed3ee', 'cb72da15-6c0a-4881-9b44-fb0c1b00aa6b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:42 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:42 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d 1G
Sep 16 22:10:42 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:42 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:42 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:43 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.261s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c74df2ff-7a19-4fc8-b0d8-2d13cd69d140 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-cc0311e7-f7d3-45a2-bf01-0636256a5a71-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:43 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d 1G" returned: 0 in 0.437s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13799ada-44ed-405f-976e-1b327161beb7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:43 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13799ada-44ed-405f-976e-1b327161beb7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d
Sep 16 22:10:43 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:43 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13799ada-44ed-405f-976e-1b327161beb7 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d" returned: 0 in 0.312s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:43 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d is being set with open permissions: ugo+rw
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:43 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d
Sep 16 22:10:43 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (3f178c54-e2f9-4faf-88f5-4c13a253b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9821a6ab-d62d-4fdf-9a9c-1e88135d7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9821a6ab-d62d-4fdf-9a9c-1e88135d7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067382166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4268d6-c8b5-40e2-b6d9-5009be8a3c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:43Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2253bba7-7f26-4baf-8d7c-456bc09ba098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2253bba7-7f26-4baf-8d7c-456bc09ba098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58ff1d3-6e37-4888-9110-8f498a71e2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58ff1d3-6e37-4888-9110-8f498a71e2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4268d6-c8b5-40e2-b6d9-5009be8a3c77', 'volume_name': 'volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fce23b4-4469-4984-bd1e-a19faf771f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fce23b4-4469-4984-bd1e-a19faf771f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1ee665-d746-4e6e-b1a0-39e7071d4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Volume ae4268d6-c8b5-40e2-b6d9-5009be8a3c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77', 'volume_size': 1}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:43 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:43 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info
Sep 16 22:10:43 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:44 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:44 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info is being set with open permissions: ugo+rw
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:44 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info
Sep 16 22:10:44 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:44 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.info" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067382166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4268d6-c8b5-40e2-b6d9-5009be8a3c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:43Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Creating volume ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:44 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:44 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 1073741824
Sep 16 22:10:44 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:44 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a4faea2b-59ec-4a03-8ca0-3a33c40c6f02 tempest-ProjectReaderTests-1250404095 None] Create snapshot completed successfully
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-acf7898e-0605-42b3-b6d4-010adbd4331d-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-acf7898e-0605-42b3-b6d4-010adbd4331d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-acf7898e-0605-42b3-b6d4-010adbd4331d" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-acf7898e-0605-42b3-b6d4-010adbd4331d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Deleting offline snapshot acf7898e-0605-42b3-b6d4-010adbd4331d of volume 13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] snapshot_file for this snap is: volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dde2a11-78a7-4139-80d2-3a30790d37bc]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:44 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d
Sep 16 22:10:44 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:44 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 1073741824" returned: 0 in 0.439s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:44 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77
Sep 16 22:10:44 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:44 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d" returned: 0 in 0.379s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:44 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13799ada-44ed-405f-976e-1b327161beb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9734b6-8036-4e46-b615-fa94d059633c]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:45 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" returned: 0 in 0.265s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1ee665-d746-4e6e-b1a0-39e7071d4182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cbcb4a-6b99-44fa-bf21-2510225e105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:45 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Volume volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 (ae4268d6-c8b5-40e2-b6d9-5009be8a3c77): created successfully
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cbcb4a-6b99-44fa-bf21-2510225e105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (3f178c54-e2f9-4faf-88f5-4c13a253b374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:45 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7
Sep 16 22:10:45 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-16ff69de-5748-4821-99ad-f98d35e34568 tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:45 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7" returned: 0 in 0.354s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:45 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d
Sep 16 22:10:45 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:45 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d" returned: 0 in 0.364s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:45 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d
Sep 16 22:10:45 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 of volume ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[7034b883-301c-4fdd-9100-2a323b2a14a5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:45 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77
Sep 16 22:10:45 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:45 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7.acf7898e-0605-42b3-b6d4-010adbd4331d" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-acf7898e-0605-42b3-b6d4-010adbd4331d" released by "_delete_snapshot" :: held 1.440s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" released by "delete_snapshot" :: held 1.463s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Created reservations ['fdff6cc2-85d5-4f87-9290-118a63d8e41f', 'fa582f77-1225-4cfe-923e-da455a77e14d', 'b55f9b20-9dd2-498f-9fee-17e9268c9a4d', 'ae8e1bc0-52d8-4b96-951a-982fa0aa0a5e'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:46 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Delete snapshot completed successfully.
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-7760684b-2004-4dbd-922c-1aed95e748b9 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-acf7898e-0605-42b3-b6d4-010adbd4331d-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:46 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" returned: 0 in 0.370s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:46 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 1G
Sep 16 22:10:46 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:46 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 1G" returned: 0 in 0.380s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:46 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1
Sep 16 22:10:46 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-13799ada-44ed-405f-976e-1b327161beb7-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-13799ada-44ed-405f-976e-1b327161beb7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf94f42-22a4-49a7-b4af-56bbe13c9d40]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:46 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" returned: 0 in 0.288s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:46 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 is being set with open permissions: ugo+rw
Sep 16 22:10:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:46 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1
Sep 16 22:10:46 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:46 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7
Sep 16 22:10:46 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:47 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:47 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info
Sep 16 22:10:47 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:47 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7" returned: 0 in 0.401s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:47 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7
Sep 16 22:10:47 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:47 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info" returned: 0 in 0.298s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info is being set with open permissions: ugo+rw
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:47 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-13799ada-44ed-405f-976e-1b327161beb7" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info
Sep 16 22:10:47 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-quobyte-13799ada-44ed-405f-976e-1b327161beb7" released by "delete_volume" :: held 0.733s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Created reservations ['e7441f7f-9f41-4cfb-b302-70c877f4e219', 'f5f9af33-29dc-4543-a4fd-4effa4f65528', '36277179-bf92-412e-aa24-4137e598788d', '22d8c339-c0fb-4ed5-8433-3a7152fa3f13'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:47 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:47 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:47 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.info" returned: 0 in 0.264s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f17ea353-d9ec-41ac-bbf8-21cb5ccd3065 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:47 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.278s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:47 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Deleted volume successfully.
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-52aabf56-01ee-434b-b156-7cdc2bf3a054 tempest-ProjectReaderTests-1250404095 None] Lock "cinder-13799ada-44ed-405f-976e-1b327161beb7-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 of volume ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5927e6-b87e-4bd7-b615-860f0d29c4c5]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:48 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1
Sep 16 22:10:48 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:48 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" returned: 0 in 0.381s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df26a1b-68c7-44af-a768-234d829487a3]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:48 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77
Sep 16 22:10:48 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:48 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" returned: 0 in 0.378s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:48 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:48 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1
Sep 16 22:10:48 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:49 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" returned: 0 in 0.355s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:49 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1
Sep 16 22:10:49 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:49 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77.21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1" released by "_delete_snapshot" :: held 1.495s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" released by "delete_snapshot" :: held 1.517s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Created reservations ['cc551a60-0ffe-450f-8de5-19cb9be351bf', '3ee5b3e7-8c6c-478c-931f-a6205084e165', '80823bcd-62e1-4849-885a-8bc7782f5e35', '5bc96384-b1bc-4d74-b87d-d6bb0f45aa1b'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:49 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:49 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-d5e8d493-d78c-4f54-a876-cecdf07a8031 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-21ad9ff5-dca4-4eb6-a3cf-28be02ec08f1-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "cinder-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18f75a1-b4be-4fe7-8fb0-0b53c6f2fe9d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:50 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77
Sep 16 22:10:50 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:50 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" returned: 0 in 0.369s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:50 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77
Sep 16 22:10:50 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:50 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" returned: 0 in 0.277s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77" released by "delete_volume" :: held 0.718s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:50 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Created reservations ['7976d28a-84bd-4289-af11-d139f07162e9', 'ea20eb41-6e61-4d31-b7f0-d82b9ed8d72f', '8c6b8b8b-cf57-4197-8ec4-b68b1071db88', '74c0377d-a95b-474c-8e61-b377d96c9b23'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:51 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:51 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:51 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.268s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:51 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-01884c75-f2e9-465f-b955-92fdebd2589d tempest-ProjectMemberTests-2129052031 None] Lock "cinder-ae4268d6-c8b5-40e2-b6d9-5009be8a3c77-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (5fe8a5ec-7a28-4b85-9104-eed1e3c5ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cd9896-cca5-42c0-a550-8802b857ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34cd9896-cca5-42c0-a550-8802b857ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231950991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e721b-f596-43d1-8f64-629aa299d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:52Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433f2d4d-6ce6-426a-a1fb-a0ba725cf470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433f2d4d-6ce6-426a-a1fb-a0ba725cf470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5bf225-99ef-4606-b02c-b1e8c7c6347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5bf225-99ef-4606-b02c-b1e8c7c6347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876e721b-f596-43d1-8f64-629aa299d2f5', 'volume_name': 'volume-876e721b-f596-43d1-8f64-629aa299d2f5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2069b-17eb-46bf-acc2-b3c06b435f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec2069b-17eb-46bf-acc2-b3c06b435f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c120c3-376c-45cb-b9e7-71d76b97e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:51 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Volume 876e721b-f596-43d1-8f64-629aa299d2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876e721b-f596-43d1-8f64-629aa299d2f5', 'volume_size': 1}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231950991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e721b-f596-43d1-8f64-629aa299d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:52Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Creating volume 876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:51 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:51 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:51 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 1073741824
Sep 16 22:10:51 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:52 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 1073741824" returned: 0 in 0.416s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:52 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5
Sep 16 22:10:52 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:52 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5" returned: 0 in 0.249s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c120c3-376c-45cb-b9e7-71d76b97e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876e721b-f596-43d1-8f64-629aa299d2f5', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae67445-f434-47b1-b5fe-a606763d6c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:52 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Volume volume-876e721b-f596-43d1-8f64-629aa299d2f5 (876e721b-f596-43d1-8f64-629aa299d2f5): created successfully
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae67445-f434-47b1-b5fe-a606763d6c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (5fe8a5ec-7a28-4b85-9104-eed1e3c5ca14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:52 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f6267ceb-1833-463e-904e-761c5a5dae7c tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot be86e96f-dc0d-4b13-9336-b44f193aff0b of volume 876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[16746181-4109-471a-9f14-0529962e064b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:53 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5
Sep 16 22:10:53 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:53 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5" returned: 0 in 0.369s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:53 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b 1G
Sep 16 22:10:53 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:53 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b 1G" returned: 0 in 0.410s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876e721b-f596-43d1-8f64-629aa299d2f5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:53 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876e721b-f596-43d1-8f64-629aa299d2f5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b
Sep 16 22:10:53 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:54 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876e721b-f596-43d1-8f64-629aa299d2f5 -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b" returned: 0 in 0.306s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:54 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b is being set with open permissions: ugo+rw
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:54 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b
Sep 16 22:10:54 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:54 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b" returned: 0 in 0.251s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:54 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info
Sep 16 22:10:54 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:54 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info" returned: 0 in 0.271s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:54 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info is being set with open permissions: ugo+rw
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:54 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info
Sep 16 22:10:54 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:54 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.info" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:54 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-cf2baf2d-42cb-47ad-9d10-128c1f7088ad tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-be86e96f-dc0d-4b13-9336-b44f193aff0b-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-be86e96f-dc0d-4b13-9336-b44f193aff0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-be86e96f-dc0d-4b13-9336-b44f193aff0b" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-be86e96f-dc0d-4b13-9336-b44f193aff0b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot be86e96f-dc0d-4b13-9336-b44f193aff0b of volume 876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[125505b4-2cc3-4468-81d9-de9b6a98c2af]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:56 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b
Sep 16 22:10:56 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:56 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b" returned: 0 in 0.373s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876e721b-f596-43d1-8f64-629aa299d2f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684585c-5d56-4eb3-be86-bfd59b0f378d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:56 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5
Sep 16 22:10:56 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:56 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5" returned: 0 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:56 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b
Sep 16 22:10:56 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:57 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b" returned: 0 in 0.346s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:57 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b
Sep 16 22:10:57 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:57 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5.be86e96f-dc0d-4b13-9336-b44f193aff0b" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-be86e96f-dc0d-4b13-9336-b44f193aff0b" released by "_delete_snapshot" :: held 1.471s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" released by "delete_snapshot" :: held 1.493s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Created reservations ['6ff3826f-bfb2-493f-b90b-8144f45aea83', '5d573796-2da6-4c01-9834-36e7ac0c9075', 'c7cdac33-9c9a-4425-b861-55fd3518219b', '85070e34-37af-4b42-852b-3a3467d17e36'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:57 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:10:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-c0213f13-4283-4a29-aa4b-b550807af183 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-be86e96f-dc0d-4b13-9336-b44f193aff0b-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-876e721b-f596-43d1-8f64-629aa299d2f5-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-876e721b-f596-43d1-8f64-629aa299d2f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" acquired by "delete_volume" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71a2176-2fad-4743-ab21-f8fcd4a7c179]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:58 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5
Sep 16 22:10:58 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:58 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5" returned: 0 in 0.383s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:58 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5
Sep 16 22:10:58 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:58 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-876e721b-f596-43d1-8f64-629aa299d2f5" returned: 0 in 0.247s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-876e721b-f596-43d1-8f64-629aa299d2f5" released by "delete_volume" :: held 0.702s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Created reservations ['6af44392-22b8-4c48-b56d-34781b197e53', 'd0f95a80-7b30-414a-bdcb-f95816851c36', '15e80d47-ff1c-49ee-b935-21dbf30a426d', '70ab3b96-06fc-4d87-b238-e79d55da739f'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:59 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:10:59 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:59 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.258s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:10:59 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-f4ac7055-5a03-4725-ac9e-43b9400a6a75 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-876e721b-f596-43d1-8f64-629aa299d2f5-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (1e162803-cca8-4230-84a8-a377715e6498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9f62f-71ee-44c4-9fe8-3fd9f29d892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab9f62f-71ee-44c4-9fe8-3fd9f29d892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030867169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928bf3eb-c0da-4c2e-9675-fc1bc2561981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:59Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae93fc8e-622b-4541-8035-9b65aa9f2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae93fc8e-622b-4541-8035-9b65aa9f2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c5bc25-371e-475b-8d70-ee4d040ae485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c5bc25-371e-475b-8d70-ee4d040ae485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928bf3eb-c0da-4c2e-9675-fc1bc2561981', 'volume_name': 'volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddbfb95-4d24-40c4-a68f-8a1d53535c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddbfb95-4d24-40c4-a68f-8a1d53535c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9930b9-0492-494c-b684-78cf39cdb5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Volume 928bf3eb-c0da-4c2e-9675-fc1bc2561981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981', 'volume_size': 1}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1030867169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928bf3eb-c0da-4c2e-9675-fc1bc2561981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:10:59Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Creating volume 928bf3eb-c0da-4c2e-9675-fc1bc2561981 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:10:59 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:10:59 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 1073741824
Sep 16 22:10:59 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (e00266d9-a4e4-4247-9b3d-47034dfd1b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e639a9ff-47f7-4414-bfc7-eea0fd34937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e639a9ff-47f7-4414-bfc7-eea0fd34937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99531187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef4a308-d4e4-4fe5-b6b5-95722e13764c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:00Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47e533-a4b9-4f6f-90b6-53a350cb877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff47e533-a4b9-4f6f-90b6-53a350cb877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836ab422-dc23-4af0-ab03-228af88ef172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836ab422-dc23-4af0-ab03-228af88ef172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef4a308-d4e4-4fe5-b6b5-95722e13764c', 'volume_name': 'volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1e4b7-e4df-4894-9e44-80d37525ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd1e4b7-e4df-4894-9e44-80d37525ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5a8d9e-6d5c-4b86-8911-1a614deb0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:10:59 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Volume 8ef4a308-d4e4-4fe5-b6b5-95722e13764c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c', 'volume_size': 1}
Sep 16 22:10:59 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:00 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 1073741824" returned: 0 in 0.428s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:00 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981
Sep 16 22:11:00 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:00 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99531187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef4a308-d4e4-4fe5-b6b5-95722e13764c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc846da094ec48e2b84bf3dd429c5822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:00Z,use_quota=True,user_id='4f2afcabcbf74aadb95ebfa9467d24da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Creating volume 8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:00 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9930b9-0492-494c-b684-78cf39cdb5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8022d1ac-d35c-4f5c-9746-13351ab9eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:00 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c 1073741824
Sep 16 22:11:00 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:00 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Volume volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 (928bf3eb-c0da-4c2e-9675-fc1bc2561981): created successfully
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8022d1ac-d35c-4f5c-9746-13351ab9eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (1e162803-cca8-4230-84a8-a377715e6498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:00 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-066b923d-ee77-4941-9fc9-c027da5b86d5 tempest-ProjectReaderTests-866307278 None] Created volume successfully.
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-928bf3eb-c0da-4c2e-9675-fc1bc2561981-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "cinder-928bf3eb-c0da-4c2e-9675-fc1bc2561981-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-quobyte-928bf3eb-c0da-4c2e-9675-fc1bc2561981" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-928bf3eb-c0da-4c2e-9675-fc1bc2561981" acquired by "delete_volume" :: waited 0.018s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d774feb-ddee-4cad-bc94-408faafa546a]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:00 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c 1073741824" returned: 0 in 0.472s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:00 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:00 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c
Sep 16 22:11:00 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:00 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981
Sep 16 22:11:00 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:01 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5a8d9e-6d5c-4b86-8911-1a614deb0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1793c49-5631-4138-8bb7-a4fe63cb5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:01 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Volume volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c (8ef4a308-d4e4-4fe5-b6b5-95722e13764c): created successfully
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1793c49-5631-4138-8bb7-a4fe63cb5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Flow 'volume_create_manager' (e00266d9-a4e4-4247-9b3d-47034dfd1b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f88b435b-6c1f-4eee-b8d1-132d3644731a tempest-ProjectMemberTests-2129052031 None] Created volume successfully.
Sep 16 22:11:01 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981" returned: 0 in 0.388s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:01 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981
Sep 16 22:11:01 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:01 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-928bf3eb-c0da-4c2e-9675-fc1bc2561981" returned: 0 in 0.244s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-928bf3eb-c0da-4c2e-9675-fc1bc2561981" released by "delete_volume" :: held 0.674s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Created reservations ['cd6c8cd3-9ebc-415b-8ed3-dd9af510daeb', 'f7f45e52-96f4-4149-a510-94c4be162df8', '813e83cf-f952-4cbc-8efa-78746ae999b4', 'a9c05920-aec3-4101-b0d8-eb40931c483d'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:01 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:01 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:01 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:01 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Deleted volume successfully.
Sep 16 22:11:01 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-4952838b-b035-410f-ad24-01ada8f044ee tempest-ProjectReaderTests-866307278 None] Lock "cinder-928bf3eb-c0da-4c2e-9675-fc1bc2561981-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Creating offline snapshot 1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f of volume 8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[58038d8c-f78b-468a-8055-0f9e4c18703b]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:02 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c
Sep 16 22:11:02 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=212,cinder:INSERT=77,cinder:UPDATE=249,cinder:DELETE=19 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=203,cinder:INSERT=76,cinder:UPDATE=290,cinder:DELETE=26 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (7dc09d68-aa16-4e05-9343-fe4907b8dcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929710ff-e3c0-4765-af11-82bb79fbbdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929710ff-e3c0-4765-af11-82bb79fbbdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168461200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf9f255-8374-40f3-a399-92a985ae1119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:02Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd5c53c-4e0f-483b-aa13-f3b6ed86d3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd5c53c-4e0f-483b-aa13-f3b6ed86d3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecb285-f1c2-4eec-9c4c-beebe7f16c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecb285-f1c2-4eec-9c4c-beebe7f16c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf9f255-8374-40f3-a399-92a985ae1119', 'volume_name': 'volume-6cf9f255-8374-40f3-a399-92a985ae1119', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da4f48d-8f2e-4064-ae05-e17394cd6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da4f48d-8f2e-4064-ae05-e17394cd6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8280354-65ea-4c2f-a5a9-84df74755a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:02 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Volume 6cf9f255-8374-40f3-a399-92a985ae1119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf9f255-8374-40f3-a399-92a985ae1119', 'volume_size': 1}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:02 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" returned: 0 in 0.371s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:02 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f 1G
Sep 16 22:11:02 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:02 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f 1G" returned: 0 in 0.402s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:02 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:02 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f
Sep 16 22:11:02 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:03 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" returned: 0 in 0.283s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:03 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f is being set with open permissions: ugo+rw
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:03 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f
Sep 16 22:11:03 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:03 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" returned: 0 in 0.233s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:03 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info
Sep 16 22:11:03 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:03 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info" returned: 0 in 0.247s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:03 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info is being set with open permissions: ugo+rw
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:03 devstack sudo[106552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info
Sep 16 22:11:03 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:03 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.info" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168461200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf9f255-8374-40f3-a399-92a985ae1119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:02Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Creating volume 6cf9f255-8374-40f3-a399-92a985ae1119 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:03 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:11:03 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:04 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 1073741824
Sep 16 22:11:04 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8dcf56bb-d0d3-4cd6-94dd-2e3a2bf17e35 tempest-ProjectMemberTests-2129052031 None] Create snapshot completed successfully
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Deleting offline snapshot 1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f of volume 8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] snapshot_file for this snap is: volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b05be5-84fb-4549-9c25-c430364381a4]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:04 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 1073741824" returned: 0 in 0.477s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:04 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119
Sep 16 22:11:04 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:04 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f
Sep 16 22:11:04 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:04 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119" returned: 0 in 0.255s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8280354-65ea-4c2f-a5a9-84df74755a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf9f255-8374-40f3-a399-92a985ae1119', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0c8e8b-35ed-4422-b261-bfb6c18f2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:04 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Volume volume-6cf9f255-8374-40f3-a399-92a985ae1119 (6cf9f255-8374-40f3-a399-92a985ae1119): created successfully
Sep 16 22:11:04 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0c8e8b-35ed-4422-b261-bfb6c18f2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (7dc09d68-aa16-4e05-9343-fe4907b8dcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" returned: 0 in 0.384s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:11:04 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-2256032f-ec52-4f86-bd1c-41385602e55d tempest-ProjectReaderTests-866307278 None] Created volume successfully.
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb117308-d6eb-4d01-812e-94a1cc7e5709]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:04 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:04 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c
Sep 16 22:11:04 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:05 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" returned: 0 in 0.351s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:05 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f
Sep 16 22:11:05 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-6cf9f255-8374-40f3-a399-92a985ae1119-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "cinder-6cf9f255-8374-40f3-a399-92a985ae1119-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:05 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" returned: 0 in 0.372s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-quobyte-6cf9f255-8374-40f3-a399-92a985ae1119" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:05 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f
Sep 16 22:11:05 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-6cf9f255-8374-40f3-a399-92a985ae1119" acquired by "delete_volume" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb25044e-00cb-4214-9353-ccb90c497bc0]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:05 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119
Sep 16 22:11:05 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:05 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c.1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" returned: 0 in 0.253s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f" released by "_delete_snapshot" :: held 1.461s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" released by "delete_snapshot" :: held 1.486s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Created reservations ['8a5a7c16-2403-40da-8506-128ff7483eb1', '41683bdd-afb7-46a8-945b-7a49fc125233', '02b385cc-94d1-4835-b00f-7335013b29af', 'd7d0aa14-f6d8-467c-b608-d6823a5f6b49'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:05 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Delete snapshot completed successfully.
Sep 16 22:11:05 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-9a2dd28b-ea19-48b0-beff-1a417637f711 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-1fa85f87-dcfe-47ca-8b71-b91f80bb1c8f-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:06 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119" returned: 0 in 0.390s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:06 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119
Sep 16 22:11:06 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:06 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-6cf9f255-8374-40f3-a399-92a985ae1119" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-6cf9f255-8374-40f3-a399-92a985ae1119" released by "delete_volume" :: held 0.677s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Created reservations ['ccff541b-5c7f-4130-a339-b7726e5d6267', '922b2985-de7e-4708-b764-ec9e3530277a', '9a20f7f6-1bad-46e5-8cf7-8f96b9c58dd6', '521cd9b8-4673-4d69-813a-87f16fa15645'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:06 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:06 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-8ef4a308-d4e4-4fe5-b6b5-95722e13764c-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-8ef4a308-d4e4-4fe5-b6b5-95722e13764c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" acquired by "delete_volume" :: waited 0.024s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec302e81-ea5d-4a3f-8b7d-57c23e538088]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:06 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.259s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:06 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Deleted volume successfully.
Sep 16 22:11:06 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-8e151957-4cf0-4b59-a6c8-9f21ad9be0be tempest-ProjectReaderTests-866307278 None] Lock "cinder-6cf9f255-8374-40f3-a399-92a985ae1119-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:06 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c
Sep 16 22:11:06 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:07 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" returned: 0 in 0.392s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:07 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c
Sep 16 22:11:07 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (266c546a-edf9-4839-9eaa-c2e76cdbda25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967bc6bc-5182-4e3f-85bc-53eb7d9c5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967bc6bc-5182-4e3f-85bc-53eb7d9c5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682658022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dada47-6980-42bb-8fd1-9597a7f82edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:07Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e31eb8-05a2-45ea-90a8-680da76f5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e31eb8-05a2-45ea-90a8-680da76f5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272d815e-a3bd-4851-8f0e-fd1e69e459b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272d815e-a3bd-4851-8f0e-fd1e69e459b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dada47-6980-42bb-8fd1-9597a7f82edc', 'volume_name': 'volume-02dada47-6980-42bb-8fd1-9597a7f82edc', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96872bb2-6a3d-4eb2-aac6-63892b1ede28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96872bb2-6a3d-4eb2-aac6-63892b1ede28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3107d8e2-8479-4f53-a5c9-3b76993f2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:07 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Volume 02dada47-6980-42bb-8fd1-9597a7f82edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dada47-6980-42bb-8fd1-9597a7f82edc', 'volume_size': 1}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1682658022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dada47-6980-42bb-8fd1-9597a7f82edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:07Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Creating volume 02dada47-6980-42bb-8fd1-9597a7f82edc {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:07 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:07 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc 1073741824
Sep 16 22:11:07 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:07 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-quobyte-8ef4a308-d4e4-4fe5-b6b5-95722e13764c" released by "delete_volume" :: held 0.711s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Created reservations ['ad6994d5-ba7e-4232-bc12-ef2bb8f307e3', '205531e5-02a4-46ea-8a96-27e625caa1bf', '4bb4137e-0bda-432c-aa59-55914a9ac5e1', 'acb612e5-bce4-48fb-9d66-e68e1250b723'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:07 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:07 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:07 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Deleted volume successfully.
Sep 16 22:11:07 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc 1073741824" returned: 0 in 0.455s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-264b922c-5e72-41d4-b25b-1fe13a3a7c67 tempest-ProjectMemberTests-2129052031 None] Lock "cinder-8ef4a308-d4e4-4fe5-b6b5-95722e13764c-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:07 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc
Sep 16 22:11:07 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:07 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc" returned: 0 in 0.264s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3107d8e2-8479-4f53-a5c9-3b76993f2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dada47-6980-42bb-8fd1-9597a7f82edc', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94291dfa-8ca5-4ebe-b41f-9fdc3fc34bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:08 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Volume volume-02dada47-6980-42bb-8fd1-9597a7f82edc (02dada47-6980-42bb-8fd1-9597a7f82edc): created successfully
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94291dfa-8ca5-4ebe-b41f-9fdc3fc34bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (266c546a-edf9-4839-9eaa-c2e76cdbda25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:08 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-f70ef0d0-0d62-4521-ad63-0f908d3d2ff4 tempest-ProjectReaderTests-866307278 None] Created volume successfully.
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-02dada47-6980-42bb-8fd1-9597a7f82edc-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "cinder-02dada47-6980-42bb-8fd1-9597a7f82edc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-quobyte-02dada47-6980-42bb-8fd1-9597a7f82edc" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-02dada47-6980-42bb-8fd1-9597a7f82edc" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[add001b0-cbe0-4ea7-8396-166df898b94d]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:08 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc
Sep 16 22:11:08 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:08 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc" returned: 0 in 0.385s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:08 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc
Sep 16 22:11:08 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:08 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-02dada47-6980-42bb-8fd1-9597a7f82edc" returned: 0 in 0.262s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:08 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-02dada47-6980-42bb-8fd1-9597a7f82edc" released by "delete_volume" :: held 0.692s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Created reservations ['b1d12d18-2ce6-4946-a207-091f4baede31', '54a0a43b-26fe-450d-85d7-8ecdf1d5ab15', '1d8fb89f-97cd-4e93-b0af-825ef3ec4636', 'd3c280cc-8fda-40b8-b49c-bc569ac76233'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:09 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:09 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:09 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.266s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:09 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Deleted volume successfully.
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-51428770-20ee-470f-8a0f-4d4d3fca6cde tempest-ProjectReaderTests-866307278 None] Lock "cinder-02dada47-6980-42bb-8fd1-9597a7f82edc-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (e9596af1-5eee-41d4-a7a1-d33b03c09a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52b21c1-6e25-4f0b-a8e9-ae084538b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52b21c1-6e25-4f0b-a8e9-ae084538b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-950334434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63da91c2-9673-44f0-a190-a04f1eb6eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:10Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9fba14-50a6-4801-8863-f0ddf265a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9fba14-50a6-4801-8863-f0ddf265a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc6a0f3-2007-4ef7-9c16-51dc2e388b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc6a0f3-2007-4ef7-9c16-51dc2e388b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63da91c2-9673-44f0-a190-a04f1eb6eb91', 'volume_name': 'volume-63da91c2-9673-44f0-a190-a04f1eb6eb91', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ce05a3-9b3c-49b1-b7c5-8eb3897e7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ce05a3-9b3c-49b1-b7c5-8eb3897e7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd34feeb-dc0b-4593-bc1e-f2d35e0bc97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:09 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Volume 63da91c2-9673-44f0-a190-a04f1eb6eb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63da91c2-9673-44f0-a190-a04f1eb6eb91', 'volume_size': 1}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-950334434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63da91c2-9673-44f0-a190-a04f1eb6eb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efc2db06c6446058cd73ee975c2ebf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:10Z,use_quota=True,user_id='5fff892e7dea46b9abce3a03911f5e6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Creating volume 63da91c2-9673-44f0-a190-a04f1eb6eb91 {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:09 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:11:09 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:09 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 1073741824
Sep 16 22:11:09 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:10 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 1073741824" returned: 0 in 0.421s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:10 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91
Sep 16 22:11:10 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:10 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91" returned: 0 in 0.248s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd34feeb-dc0b-4593-bc1e-f2d35e0bc97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63da91c2-9673-44f0-a190-a04f1eb6eb91', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1227504b-f802-44c0-99df-e253e63b2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:10 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Volume volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 (63da91c2-9673-44f0-a190-a04f1eb6eb91): created successfully
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1227504b-f802-44c0-99df-e253e63b2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Flow 'volume_create_manager' (e9596af1-5eee-41d4-a7a1-d33b03c09a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:10 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-125d43e8-2869-438a-8059-a0d88c4bd229 tempest-ProjectReaderTests-866307278 None] Created volume successfully.
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-63da91c2-9673-44f0-a190-a04f1eb6eb91-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "cinder-63da91c2-9673-44f0-a190-a04f1eb6eb91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Acquiring lock "cinder-quobyte-63da91c2-9673-44f0-a190-a04f1eb6eb91" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-63da91c2-9673-44f0-a190-a04f1eb6eb91" acquired by "delete_volume" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa04928e-2250-43ea-b69a-7c8fcbf45199]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:10 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:11 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91
Sep 16 22:11:11 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:11 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91" returned: 0 in 0.395s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:11 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91
Sep 16 22:11:11 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:11 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-63da91c2-9673-44f0-a190-a04f1eb6eb91" returned: 0 in 0.250s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "cinder-quobyte-63da91c2-9673-44f0-a190-a04f1eb6eb91" released by "delete_volume" :: held 0.694s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Created reservations ['7f40caa6-52ea-46d2-9431-52089cbaa353', '79a9e954-0345-47b1-b01f-fde17190399d', '32ffa1df-e600-4709-b730-228e9ee02bcc', '2af5ec4d-1e26-4b09-b4fe-5f6d6b2b34b8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:11 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:11 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:11 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:11 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:12 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.252s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:12 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:12 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Deleted volume successfully.
Sep 16 22:11:12 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-0eb85e27-26b2-427a-beb9-920b3e76da8e tempest-ProjectReaderTests-866307278 None] Lock "cinder-63da91c2-9673-44f0-a190-a04f1eb6eb91-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:22 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:22 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:22 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.254s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:11:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 22:11:29 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=29,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:11:29 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=35,cinder:UPDATE=48,cinder:DELETE=3,cinder:INSERT=11 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Flow 'volume_create_manager' (d80b95cb-e351-4963-b38d-0da19291a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9b845d-4827-4bbf-93b4-799254c2f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9b845d-4827-4bbf-93b4-799254c2f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979267689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d54a08-fb58-4c48-887c-a5fdaa8e50ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496edcc5c7974fb78909e07be4dff9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:42Z,use_quota=True,user_id='49bdec7d7db54edd96504aceae168a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2bb28e-de6a-486f-9c8a-d4c042f85903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2bb28e-de6a-486f-9c8a-d4c042f85903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e606e269-435e-4f22-986c-ce03ed378494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e606e269-435e-4f22-986c-ce03ed378494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d54a08-fb58-4c48-887c-a5fdaa8e50ad', 'volume_name': 'volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a767070b-a293-4af0-b636-8ec911f94992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a767070b-a293-4af0-b636-8ec911f94992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8fda0a-2b13-44aa-9bc7-7083cbcec866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:42 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Volume 42d54a08-fb58-4c48-887c-a5fdaa8e50ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad', 'volume_size': 1}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d82b13c5d00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979267689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d54a08-fb58-4c48-887c-a5fdaa8e50ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496edcc5c7974fb78909e07be4dff9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:42Z,use_quota=True,user_id='49bdec7d7db54edd96504aceae168a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)}" {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Creating volume 42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:42 devstack cinder-volume[85936]: INFO cinder.volume.drivers.remotefs [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] casted to osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad 1073741824 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:42 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad 1073741824
Sep 16 22:11:42 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:42 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad 1073741824" returned: 0 in 0.413s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:42 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:42 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:42 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:43 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.235s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'} {{(pid=85936) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8fda0a-2b13-44aa-9bc7-7083cbcec866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad', 'volume_size': 1}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e540a-5b9a-4a31-8897-c1b4c851e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:43 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Volume volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad (42d54a08-fb58-4c48-887c-a5fdaa8e50ad): created successfully
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7e540a-5b9a-4a31-8897-c1b4c851e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Flow 'volume_create_manager' (d80b95cb-e351-4963-b38d-0da19291a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:43 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-52c873be-1fda-46cf-9bbc-5b4278e7ee6b tempest-SnapshotDependencyTests-1873597572 None] Created volume successfully.
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Creating offline snapshot 34a14a9d-03d4-432c-9798-3c4a0c8aa18a of volume 42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf2ed65-c078-4939-8aa1-8c7a4680649e]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:43 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:43 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:43 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.344s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:43 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a 1G {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:43 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a 1G
Sep 16 22:11:43 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:44 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a 1G" returned: 0 in 0.377s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:44 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:44 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:44 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad -F qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.283s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:44 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a is being set with open permissions: ugo+rw
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:44 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:44 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:44 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.242s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:44 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:44 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info
Sep 16 22:11:44 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:45 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:45 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info is being set with open permissions: ugo+rw
Sep 16 22:11:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:45 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info
Sep 16 22:11:45 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:45 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.info" returned: 0 in 0.240s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:45 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:45 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-7b9d2e34-cbef-41ab-920c-168cb1175249 tempest-SnapshotDependencyTests-1873597572 None] Create snapshot completed successfully
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85936) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Flow 'volume_create_manager' (5af858ca-7773-4af2-8567-49be0c960031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937d56ec-6fc3-4204-80bd-245029d2c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937d56ec-6fc3-4204-80bd-245029d2c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T20:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aff79b2-168b-4ad3-b0e7-c9a42043efc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496edcc5c7974fb78909e07be4dff9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T20:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34a14a9d-03d4-432c-9798-3c4a0c8aa18a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T20:11:46Z,use_quota=True,user_id='49bdec7d7db54edd96504aceae168a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14b3082-6b18-44c3-8213-83b8946ef589),volume_type_id=b14b3082-6b18-44c3-8213-83b8946ef589)' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb01c85-c2e7-4e53-9130-e80ed21bd0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb01c85-c2e7-4e53-9130-e80ed21bd0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e67212-1af5-4f37-ac28-0d2e3027d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e67212-1af5-4f37-ac28-0d2e3027d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0aff79b2-168b-4ad3-b0e7-c9a42043efc5', 'volume_name': 'volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5', 'volume_size': 1, 'snapshot_id': '34a14a9d-03d4-432c-9798-3c4a0c8aa18a'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b545dba1-95ce-49a9-84cc-701061b46bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b545dba1-95ce-49a9-84cc-701061b46bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9670ddee-bff5-44ea-841f-7af40f832373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:46 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Volume 0aff79b2-168b-4ad3-b0e7-c9a42043efc5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5', 'volume_size': 1, 'snapshot_id': '34a14a9d-03d4-432c-9798-3c4a0c8aa18a'}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" by "_create_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Creating volume 0aff79b2-168b-4ad3-b0e7-c9a42043efc5 from snapshot 34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Selected osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c as target Quobyte volume. {{(pid=85936) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" by "_copy_volume_from_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] snapshot: 34a14a9d-03d4-432c-9798-3c4a0c8aa18a, volume: 0aff79b2-168b-4ad3-b0e7-c9a42043efc5,  {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[64989f92-2f94-4d72-85e5-65ab70fb02ea]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:46 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:46 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:46 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.355s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[2991a978-a074-4369-849c-520134e9da64]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:46 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:46 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:46 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:47 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.345s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 22:11:47 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Creating direct copy from snapshot {{(pid=85936) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 22:11:47 devstack cinder-volume[85936]: DEBUG cinder.utils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Path /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 not found in is_blk_device check {{(pid=85936) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 22:11:47 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:47 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5
Sep 16 22:11:47 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:52 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" returned: 0 in 5.982s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:52 devstack cinder-volume[85936]: DEBUG cinder.image.image_utils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Image conversion details: src /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 {{(pid=85936) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 22:11:52 devstack cinder-volume[85936]: INFO cinder.image.image_utils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Converted 1024.00 MB image at 171.15 MB/s
Sep 16 22:11:52 devstack cinder-volume[85936]: WARNING cinder.volume.drivers.remotefs [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 is being set with open permissions: ugo+rw
Sep 16 22:11:52 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:53 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5
Sep 16 22:11:53 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:53 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" returned: 0 in 0.235s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" released by "_copy_volume_from_snapshot" :: held 6.993s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" released by "_create_volume_from_snapshot" :: held 7.051s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.066s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9670ddee-bff5-44ea-841f-7af40f832373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5', 'volume_size': 1, 'snapshot_id': '34a14a9d-03d4-432c-9798-3c4a0c8aa18a'}' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b40d1d-5a03-4f74-a8eb-59caef712644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 22:11:53 devstack cinder-volume[85936]: INFO cinder.volume.flows.manager.create_volume [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Volume volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 (0aff79b2-168b-4ad3-b0e7-c9a42043efc5): created successfully
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b40d1d-5a03-4f74-a8eb-59caef712644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85936) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Flow 'volume_create_manager' (5af858ca-7773-4af2-8567-49be0c960031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85936) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 22:11:53 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-a83ac1e5-eb96-4957-96af-0108e3164e90 tempest-SnapshotDependencyTests-1873597572 None] Created volume successfully.
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-delete_snapshot" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" by "delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a" by "_delete_snapshot" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Deleting offline snapshot 34a14a9d-03d4-432c-9798-3c4a0c8aa18a of volume 42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] snapshot_file for this snap is: volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c99cf-0c97-4746-9322-e7924bf41a04]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:53 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:53 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:53 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:54 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.359s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.remotefs [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85936) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c5adbd-8448-4146-8730-f8359e98801f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:54 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:54 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:54 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.523s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:54 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:54 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:54 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.311s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:54 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:54 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a
Sep 16 22:11:54 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:55 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad.34a14a9d-03d4-432c-9798-3c4a0c8aa18a" returned: 0 in 0.243s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-34a14a9d-03d4-432c-9798-3c4a0c8aa18a" released by "_delete_snapshot" :: held 1.530s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" released by "delete_snapshot" :: held 1.552s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Created reservations ['e8fb8e83-06d0-4750-bef4-1e96600d4aba', 'cca57679-49db-48b1-96f6-2f774b80a441', '44e2acc1-a4df-41f4-a649-01f922a2ffe1', '3677e448-ea8e-40e1-ba79-b0b4a41c6ccb'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:55 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Delete snapshot completed successfully.
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-964ec605-6984-4054-b7b6-d87e120338b7 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-34a14a9d-03d4-432c-9798-3c4a0c8aa18a-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-42d54a08-fb58-4c48-887c-a5fdaa8e50ad-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-42d54a08-fb58-4c48-887c-a5fdaa8e50ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f84aa-1e7f-4780-bed7-613cfa6a494f]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:55 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:56 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:56 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:56 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.349s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:56 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad
Sep 16 22:11:56 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:56 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" returned: 0 in 0.238s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-42d54a08-fb58-4c48-887c-a5fdaa8e50ad" released by "delete_volume" :: held 0.643s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Created reservations ['0d7a24ff-d8f3-43cd-bc5d-4e8dfdc938fc', 'bd4a6d3c-c9c0-41c7-8e62-cf554bb00f0d', 'b2cb30a1-e043-4c32-9343-c746e7139113', 'ffd06e39-a4c5-4bf7-aeb1-f115d703c7b8'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:56 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:56 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:56 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.241s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:56 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Deleted volume successfully.
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-85186e3a-01f8-4983-86c3-b73667ae910a tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-42d54a08-fb58-4c48-887c-a5fdaa8e50ad-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-0aff79b2-168b-4ad3-b0e7-c9a42043efc5-delete_volume" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:56 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-0aff79b2-168b-4ad3-b0e7-c9a42043efc5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" by "delete_volume" {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" acquired by "delete_volume" :: waited 0.014s {{(pid=85936) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad9254-ed5b-4a6a-b271-47d2ec981ff6]: (4, 'qcow2') {{(pid=87951) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:57 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5
Sep 16 22:11:57 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:57 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" returned: 0 in 0.363s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:57 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5
Sep 16 22:11:57 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:57 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793/volume-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" returned: 0 in 0.235s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-quobyte-0aff79b2-168b-4ad3-b0e7-c9a42043efc5" released by "delete_volume" :: held 0.635s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.quota [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Created reservations ['66329eed-3b30-4852-9c2c-41602606a21c', 'db85771c-c9e0-478e-9d72-73400642316a', '7678cc49-081b-4087-9a00-b9b5dea3cebe', '138447e7-9062-4795-803e-bfd1db382df7'] {{(pid=85936) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:11:57 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:11:57 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:11:57 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:11:57 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Sep 16 22:11:58 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.232s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:11:58 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:11:58 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Deleted volume successfully.
Sep 16 22:11:58 devstack cinder-volume[85936]: DEBUG cinder.coordination [None req-be4527a6-aaec-4b44-8dcf-6171f517ec93 tempest-SnapshotDependencyTests-1873597572 None] Lock "cinder-0aff79b2-168b-4ad3-b0e7-c9a42043efc5-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=85936) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 22:12:07 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:UPDATE=30,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=2 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:12:08 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writing DB stats cinder:SELECT=29,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c': None} {{(pid=85936) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG cinder.volume.drivers.quobyte [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-44bc0946-2c83-41af-ac74-9142cea56f2c'] {{(pid=85936) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85936) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793 {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 22:12:22 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793
Sep 16 22:12:22 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 22:12:22 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_concurrency.processutils [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fdb64a4a70355b21db9cc6d0b48bc793" returned: 0 in 0.246s {{(pid=85936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG cinder.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Notifying Schedulers of capabilities ... {{(pid=85936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG oslo_service.periodic_task [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] Running periodic task VolumeManager._thread_info {{(pid=85936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread count: 28 {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 22:12:22 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-d4273294-7f74-460d-bade-84c5af55fc7d None None] thread info: [<_MainThread(MainThread, started 138000374235264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138000260722496)>, <Thread(Thread-3 (stat_writer), started daemon 138000259024128)>, <Thread(Rabbit-heartbeat, started daemon 138000260031936)>, <Thread(Thread-5 (_runner), started daemon 138000257841280)>, <Thread(Thread-7 (_runner), started daemon 138000257901696)>, <Thread(fd_logger, started daemon 138000254040512)>, <Thread(privsep_reader, started daemon 138000254067840)>, <Thread(tpool_thread_0, started daemon 138000247097024)>, <Thread(tpool_thread_1, started daemon 138000238704320)>, <Thread(tpool_thread_2, started daemon 138000230311616)>, <Thread(tpool_thread_3, started daemon 138000221918912)>, <Thread(tpool_thread_4, started daemon 138000213526208)>, <Thread(tpool_thread_5, started daemon 138000205133504)>, <Thread(tpool_thread_6, started daemon 138000196740800)>, <Thread(tpool_thread_7, started daemon 138000188348096)>, <Thread(tpool_thread_8, started daemon 138000179955392)>, <Thread(tpool_thread_9, started daemon 138000171562688)>, <Thread(tpool_thread_10, started daemon 138000163169984)>, <Thread(tpool_thread_11, started daemon 138000154777280)>, <Thread(tpool_thread_12, started daemon 138000146384576)>, <Thread(tpool_thread_13, started daemon 138000137991872)>, <Thread(tpool_thread_14, started daemon 138000129599168)>, <Thread(tpool_thread_15, started daemon 138000121206464)>, <Thread(tpool_thread_16, started daemon 138000112813760)>, <Thread(tpool_thread_17, started daemon 138000104404672)>, <Thread(tpool_thread_18, started daemon 138000095995584)>, <Thread(tpool_thread_19, started daemon 138000087586496)>] {{(pid=85936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}